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@ Handwriting input apparatus using more than one sensing technique. 



@ Handwriting recognition apparatus including 
handwriting input apparatus employing at least 
two different sensing techniques to sense hand- 
writing and symbol identification apparatus re- 
ceiving an output of the handwriting input 
apparatus for providing an output indication of 
symbols represented by the handwriting. 
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FIELD OF THE INVENTION 

The present invention relat s to computer input devices generally and more particularly to handwriting rec- 
ognition computer input devices. 

5 

BACKGROUND OF THE INVENTION 

There exists a significant amount of activity in the field of on-line handwriting recognition. The prior art 
current to 1990 is reviewed in The State of the Art in On-Line Handwriting Recognition" by Charles C. Tappert 
10 et al, IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 12, No. 8, August, 1990. 

Generally speaking, on-line handwriting analysis is currently employed for two distinct applications: iden- 
tity verification and input of handwritten letters and numbers into a computer. These two applications hav 
sharply contrasting operational requirements and goals. Handwriting analysis for identity verification senses 
features of handwriting which are distinct for each individual and thus can be used to unambiguously identify 
is a given individual. In contrast, handwriting analysis for alphanumeric input to a computer seeks to minimize 
the effect of the very features which are important for identity verification and to concentrate on universal hand- 
writing characteristics which can be associated with given symbols independently of the individual writer. 

Currently existing and proposed systems providing handwriting analysis for alphanumeric input to a com- 
puter are generally geared towards recognition of how a symbol looks rather than how it is created. Accordingly, 
20 such systems employ digitizers or graphic tablets. 

Signature verification systems, on the other hand, attempt to identify biometric characteristics of the writer 
and employ indications such as pressure and acceleration during writing. 

U.S. Patent 4,345,239 employs pen acceleration for use in a signature verification system. U.S. Patent 
5,054,088 employs both acceleration and pressure data characteristics of handwriting for identity verification. 
25 As indicated by the above patents, pen acceleration is employed for signature verification because it is a per- 
sonal feature, characteristic of each individual. Accordingly, pen acceleration has not been employed for al- 
phanumeric input. 

U.S. Patent 4,751 ,741 describes pen-type character recognition apparatus which employs pen pressure 
data exclusively. 

30 U.S. Patent 4,695,741 describes a light-pen equipped with an accelerometer for detecting tapping of th 

pen on a computer screen. As indicated by the above patent, pen acceleration is not used more generally to 
determine contact between a pen and a surface. 

U.S. Patent 4,845,684 describes a hand-held ultrasonic apparatus for detecting contact between a pen 
and a writing surface. The above patent does not disclose use of acceleration data. 

35 U.S. Patent 4,122,435 describes an apparatus using accelerometers which, when employed to write on a 

special surface, produces signals which can be used for handwriting analysis. 

Position digitization through ultrasonic position digitization is well-known in the prior art, as for example 
in U.S. Patents 3,731,273; 4,317,005; 4,357,672; 4,578,674; 4,654,648; 4,758,691; 4,814,552; 4,862,152; 
4.991,148; 5,142.506; 5.214.615; 5,239,139; and 5,280,457. Other publications describing ultrasonic position 

40 digitization include "A sonic pen: a digital stylus system" by Brenner and DeBruyne, IEEE Transactions on Com- 
puters, Vol. C-19, No. 6 t June 1970, pp. 546-546; "Compact Large-Area Graphic Digitizer for PC by DeBruyne, 
IEEE Computer Graphics and Applications, December 1986, pp. 49-53; IBM Technical Disclosure Bulletin. Vol. 
12, No. 3., August 1969, p. 390; and "US Cursor Position Detection", IBM Technical Disclosure Bulletin, Vol. 
27, No. 11. Apr 1985. 

45 in practice digitized positions derived from ultrasonic measurement are not determined precisely enough 

to allow even minimally operative handwriting recognition, so that handwriting recognition from ultrasonic pos- 
ition detection is not known in the prior art 



50 



55 



SUMMARY OF THE INVENTION 

The present invention seeks to provided an improved computer input device. 

There is thus provided in accordance with a preferred embodiment of the present invention handwriting 
recognition apparatus including handwriting input apparatus employing at least two different sensing techni- 
ques to sense handwriting, and symbol identification apparatus receiving an output of th handwriting input 
apparatus for providing an output indication of symbols represented by the handwriting. 

Further in accordance with a preferred embodiment of the present invention the handwriting input appa- 
ratus includes a position digitizer and at least one accelerometer located in a hand held writing implement 

Still further in accordance with a preferred embodiment of the present invention the handwriting input ap- 
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paratus includes ultrasonic position d termination apparatus and at least one accelerometer locat d in a hand 
held writing implem nt. 

Additionally in accordance with a preferred embodiment of the present invention the handwriting input ap- 
paratus is operativ to write on a computer screen. 

There is also provided in accordance with another preferred embodiment of the present invention appa- 
ratus for detecting pen-surface contact including at least one accelerometer measuring at least one component 
of acceleration of a user's hand manipulating a pen, and a pen-surface contact detector receiving input from 
the accelerometer. 

Further in accordance with a preferred embodiment of the present invention the at least one accelerometer 
includes a plurality of mutually orthogonally disposed accelerometers. 

Still further in accordance with a preferred embodiment of the present invention the symbol identification 
apparatus includes combined position and acceleration processing apparatus which combines the inputs from 
the digitizer and the at least one accelerometer in identifying symbols. 

Additionally in accordance with a preferred embodiment of the present invention the symbol identification 
apparatus includes a first identification channel for employing input from the digitizer to provide a first output 
representing identification of symbols, a second identification channel for employing input from the at least 
on accelerometer to provide a second output representing identification of symbols, and symbol selection ap- 
paratus for selecting between the first and the second outputs based on predetermined criteria. 

Further in accordance with a preferred embodiment of the present invention the detector includes an ac- 
celeration noise analyzer operative to extract noise out of the acceleration data. 

Still further In accordance with a preferred embodiment of the present invention the at least one acceler- 
ometer is retroflttable onto the pen. 

There is also provided in accordance with another preferred embodiment of the present invention a hand- 
writing recognition method including receiving information regarding the acceleration of a writing implement, 
and identifying symbols written by the writing implement at least partly on the basis of a comparison between 
the acceleration of the writing implement and stored acceleration sequences characterizing each of a plurality 
of symbols. 

There is also provided in accordance with another preferred embodiment of the present invention hand- 
writing recognition apparatus including a characteristic acceleration sequence memory operative to store ac- 
celeration sequences characterizing each of a plurality of symbols, a writing implement monitor operative to 
receive information regarding acceleration of a writing implement, and a symbol identifier operative to provide 
an output indication of symbols written by the writing implement at least partly on the basis of a comparison 
between the acceleration of the writing implement and the stored acceleration sequences. 

Further in accordance with a preferred embodiment of the present invention the writing implement monitor 
is also operative to receive information regarding the position of the writing implement 

There is also provided in accordance with another preferred embodiment of the present invention a hand- 
writing recognition method including employing at least two different sensing techniques to sense handwriting, 
and receiving an output of the sensing techniques for providing an output indication of symbols represented 
by the handwriting. 

Further in accordance with a preferred embodiment of the present invention the sensing techniques include 
position digitizing, and employing at least one accelerometer located in a hand held writing implement to sense 
acceleration. 

There is also provided in accordance with another preferred embodiment of the present invention a method 
for detecting pen-surface contact including employing at least one accelerometer measuring at least one com- 
ponent of acceleration of a user's hand manipulating a pen, and receiving input from the accelerometer and 
providing an output indication of pen-surface contact. 

Further in accordance with a preferred embodiment of the present invention the method also includes iden- 
tifying symbols by combining digitized position inputs and sensed acceleration information. 

Further in accordance with a preferred embodiment of the present invention the receiving step includes 
employing digitized position inputs to provide a first output representing identification of symbols, employing 
acceleration information to provide a second output representing identification of symbols, and selecting be- 
tween the first and second outputs. 

There is also provided in accordance with another preferred embodiment of the present invention hand- 
writing recognition apparatus including handwriting input apparatus including at least first and second differ nt 
handwriting sensors producing first and second handwriting outputs, and an associator for combining the first 
and second handwriting outputs to provide an enhanced performance handwriting output, and symbol identi- 
fication apparatus receiving the enhanced performance handwriting output for providing an output indication 
of symbols represented by the handwriting. 
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Further in accordance with a preferred embodiment of th present inv ntion and the first handwriting sen- 
sor includes at least one accelerometer. 

Still further in accordance with a preferred embodiment of the present invention the second handwriting 
sensor includ s a pad. 

5 Additionally in accordance with a preferred embodiment of the present invention and wherein the second 

handwriting sensor includes ultrasonic position determination apparatus. 

Further in accordance with a preferred embodiment of the present invention the second handwriting sensor 
is operative to sense handwriting on a computer screen. 

Still further in accordance with a preferred embodiment of the present invention the handwriting recogni- 
10 tion apparatus includes a writing implement. 

Additionally in accordance with a preferred embodiment of the present invention at least one of the first 
and second handwriting sensors includes apparatus operative to sense the location of the writing implement. 

Further in accordance with a preferred embodiment of the present invention the associator is operative to 
correlate first and second handwriting outputs in a two dimensional domain. 
15 Still further in accordance with a preferred embodiment of the present invention the associator is operative 

to correlate first and second handwriting outputs in a time domain. 

There is also provided in accordance with another preferred embodiment of the present invention a hand- 
writing recognition method including employing at least first and second different handwriting sensors to pro- 
duce first and second handwriting outputs, combining the first and second handwriting outputs to provide an 
20 enhanced performance handwriting output, and employing the enhanced performance handwriting output for 
providing an output indication of symbols represented by the handwriting. 

Further in accordance with a preferred embodiment of the present invention the first handwriting sensor 
senses acceleration. 

Still further in accordance with a preferred embodiment of the present invention at least one of the first 
25 and second handwriting sensors is operative to sense the location of a writing implement 

Additionally in accordance with a preferred embodiment of the present invention the step of combining in- 
cludes correlating the first and second handwriting outputs in a two dimensional domain. 

Further in accordance with a preferred embodiment of the present invention the step of combining includes 
correlating the first and second handwriting outputs in a time domain. 
30 There is also provided in accordance with a preferred embodiment of the present invention hand imaging 

recognition apparatus including hand imaging input apparatus employing at least two different sensing tech- 
niques to sense hand imaging, and shape identification apparatus receiving an output of the hand imaging 
input apparatus for providing an output indication of shapes represented by the hand imaging. 

Further in accordance with a preferred embodiment of the present invention the hand imaging input ap- 
35 paratus includes a position digitizer and at least one accelerometer located in a hand held writing implement 
Still further in accordance with a preferred embodiment of the present invention the hand imaging includes 
at least one of drawing and handwriting. 

Additionally in accordance with a preferred embodiment of the present invention the input apparatus in- 
cludes ultrasonic position determination apparatus and at least one accelerometer located in a hand held writ- 
40 ing implement 

Further in accordance with a preferred embodiment of the present invention the shape identification ap- 
paratus includes combined position and acceleration processing apparatus which combines the inputs from 
the digitizer and the at least one accelerometer in identifying shapes. 

Still further in accordance with a preferred embodiment of the present invention the shape identification 
45 apparatus includes a first identification channel for employing input from the digitizer to provide a first output 
representing identification of shapes, a second identification channel for employing input from the at least on 
accelerometer to provide a second output representing identification of shapes, and shape selection apparatus 
for selecting between the first and the second outputs based on predetermined criteria. 

Further in accordance with a preferred embodiment of the present invention the at least one accelerometer 
so is retrof ittable onto a pen. 

There is also provided in accordance with another preferred embodiment of the present invention a hand 
imaging recognition method including receiving information regarding the acceleration of a writing implement, 
and identifying shapes written by the writing implement at least partly on the basis of a comparison between 
the acceleration of the writing implement and stored acceleration sequences characterizing each of a plurality 
55 of shapes. 

Further in accordance with a preferred embodiment of the present invention the hand imaging recognition 
method also includes receiving information regarding the position of a writing implement. 

Still further in accordance with a preferred embodiment of the present invention the hand imaging recog- 
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nition method also includes storing acceleration sequences characterizing each of a first plurality of shapes 
as generated by each of a second plurality of us rs. 

There is also provided in accordance with another preferred embodiment of the present invention hand 
imaging recognition apparatus including a characteristic acceleration sequence memory operative to store ac- 
celeration sequences characterizing each of a plurality of shapes, a writing implement monitor operative to re- 
ceive information regarding acceleration of a writing implement, and a shape identifier operative to provide an 
output indication of shapes written by the writing implement at least partly on the basis of a comparison be- 
tween the acceleration of the writing implement and the stored acceleration sequences. 

Further in accordance with a preferred embodiment of the present invention the writing implement monitor 
is also operative to receive information regarding the position of the writing implement 

There is also provided in accordance with another preferred embodiment of the present invention a hand 
imaging recognition method including employing at least two different sensing techniques to sense hand im- 
aging, and receiving an output of the sensing techniques for providing an output indication of shapes repre- 
sented by the hand imaging. 

Further in accordance with a preferred embodiment of the present invention the sensing techniques include 
position digitizing, and employing at least one accelerometer located in a hand held writing implement to sense 
acceleration. 

Still further in accordance with a preferred embodiment of the present invention the hand imaging recog- 
nition method also includes identifying shapes by combining digitized position inputs and sensed acceleration 
information. 

Additionally in accordance with a preferred embodimentof the present invention the receiving step includes 
employing digitized position inputs to provide a first output representing identification of shapes, employing 
acceleration Information to provide a second output representing Identification of shapes, and selecting be- 
tween the first and second outputs. 

Further in accordance with a preferred embodiment of the present invention the receiving includes extract- 
ing noise out of the acceleration data. 

There is also provided in accordance with another preferred embodiment of the present invention hand 
imaging recognition apparatus including hand imaging input apparatus including at least first and second dif- 
ferent hand imaging sensors producing first and second hand imaging outputs, and an associator for combining 
the first and second hand imaging outputs to provide an enhanced performance hand imaging output, and 
shape identification apparatus receiving the enhanced performance hand imaging output for providing an out- 
put indication of shapes represented by the hand imaging. 

Further in accordance with a preferred embodiment of the present invention the first hand imaging sensor 
includes at least one accelerometer. 

Still further in accordance with a preferred embodimentof the present invention the second hand imaging 
sensor includes a pad. 

Additionally in accordance with a preferred embodiment of the present invention the second handwriting 
sensor includes an ultrasonic position determination apparatus. 

Further in accordance with a preferred embodiment of the present invention the hand imaging recognition 
apparatus includes a writing implement. 

Further in accordance with a preferred embodiment of the present invention 50 at least one of the first 
and second handwriting sensors includes apparatus operative to sense the location of the writing implement. 

Still further in accordance with a preferred embodiment of the present invention the associator is operative 
to correlate first and second hand imaging outputs in a two dimensional domain. 

Further in accordance with a preferred embodiment of the present invention the associator is operative to 
correlate first and second hand imaging outputs in a time domain. 

There is also provided in accordance with another preferred embodiment of the present invention hand 
imaging recognition method including employing at least first and second different hand imaging sensors to 
produce first and second hand imaging outputs, combining the first and second hand imaging outputs to pro- 
vide an enhanced performance hand imaging output, and employing the enhanced performance hand imaging 
output for providing an output indication of shapes represented by the hand imaging. 

Further in accordance with a preferred embodiment of the present invention the first hand imaging sensor 
senses acceleration. 

Still further in accordance with a preferred embodiment of the present invention at least one of the first 
and second handwriting sensors is operative to sense the location of a writing implement 

Additionally in accordance with a preferred embodiment of th present invention the step of combining in- 
cludes correlating the first and second hand imaging outputs in a two dimensional domain. 

Further in accordance with a preferred embodiment of the present invention the step of combining includes 
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correlating the first and second hand imaging outputs in a time domain. 

Still further in accordance with a preferred embodiment of the present invention the handwriting input ap- 
paratus includes optical character recognition apparatus. 

Additionally in accordance with a preferred embodiment of the present invention the at least one acceler- 
5 ometer includes a plurality of accelerometers. 

t Moreover in accordance with a preferred embodiment of the present invention the plurality of accelerom- 
eters is mutually orthogonally disposed. 

Further in accordance with a preferred embodiment of the present invention the symbol identification ap- 
paratus includes combined position and acceleration processing apparatus which combines the inputs from 
10 the optical character recognition apparatus and the at least one accelerometer in identifying symbols. 

Still further in accordance with a preferred embodiment of the present invention the symbol identification 
apparatus includes a first identification channel for employing input from the optical character recognition ap- 
paratus to provide a first output representing identification of symbols, a second identification channel for em- 
ploying input from the at least one accelerometer to provide a second output representing identification of sym- 
15 bols, and symbol selection apparatus for selecting between the first and the second outputs based on prede- 
termined criteria. 

Additionally in accordance with a preferred embodiment of the present invention the least one accelerom- 
eter is retrof ittable onto a pen. 

Moreover in accordance with a preferred embodiment of the present invention the input apparatus com- 
20 prises optical recognition apparatus. 

Further in accordance with a preferred embodiment of the present invention the shape identification ap- 
paratus includes combined optical character recognition and acceleration processing apparatus which com- 
bines the inputs from the optical character recognition apparatus and the at least one accelerometer in iden- 
tifying shapes. 

25 still further in accordance with a preferred embodiment of the present invention the shape identification 

apparatus includes a first identification channel for employing input from the optical character recognition ap- 
paratus to provide a first output representing identification of shapes, a second identification channel for em- 
ploying input from the at least one accelerometer to provide a second output representing identification of 
shapes, and shape selection apparatus for selecting between the first and the second outputs based on pre- 

30 determined criteria. 

BRIEF DESCRIPTION OF THE DRAWINGS AND APPENDICES 

The present invention will be understood and appreciated from the following detailed description, taken 

35 in conjunction with the drawings in which: 

Fig. 1Ais a simplified semi-pictorial semi-block diagram Illustration of handwriting recognition apparatus 
constructed and operative in accordance with a preferred embodiment of the present invention; 
Fig. 1B is a simplified semi-pictorial semi-block diagram illustration of handwriting recognition apparatus 
constructed and operative in accordance with an alternative preferred embodiment of the present inven- 

40 tion; 

Figs. 2A through 2H are schematic drawings of preferrad structures of portions of the apparatus of Figs. 
1Aand 1B; 

Fig. 3 is a simplified block diagram of the handwriting recognition apparatus of Figs. 1 A and 1 B; 
Fig. 4A is a simplified flow chart illustrating the teaching process performed by the handwriting recognition 
45 apparatus of Figs. 1 A and 1 B; 

Fig. 4B is a simplified flow chart illustrating the recognition process performed by the handwriting recog- 
nition apparatus of Figs. 1Aand 1B; 

Figs. 5A through 5D are graphical depictions of data illustrating a preferred method for a portion of the 
teaching and recognition processes performed by the handwriting recognition apparatus of Figs. 1 A and 
50 1B; 

Fig. 6A is a simplified illustration of a preferred mechanical structure of the digitizing pen/accelerometer 
of Fig. 1A; 

Fig. 6B is a simplified illustration of a preferred mechanical structure of the digitizing pen/accelerometer 
of Fig. 1B; 

55 Fig. 7 is a simplified semi-pictorial semi-block diagram of handwriting recognition apparatus constructed 

and operative in accordance with another alternative preferred embodiment of the present invention; 
Fig. 8 is a simplified block diagram of the handwriting recognition apparatus of Fig. 7; 
Fig. 9Ais a simplified flow chart illustrating the teaching process perform d by the handwriting recognition 
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apparatus of Fig. 7; and 

Fig. 9B is a simplified flow chart illustrating the recognition process performed by the handwriting recog- 
nition apparatus f Fig. 7. 

Attached herewith ar the following appendices which aid in the understanding and appreciation of pre- 
ferred embodiments of the invention shown and described herein: 

Appendix A is a computer listing comprising a preferred implementation of portions of steps 220 and 300 
of Figs. 4A and 4B and of steps 720 and 800 of Figs. 9A and 9B; 

Appendix B is a computer listing comprising another preferred implementation of portions of steps 220 and 
300, and a preferred implementation of steps 31 0 and 320, all of Figs. 4A and 4B; 
Appendix C is a computer listing comprising a preferred implementation of the apparatus of Figs. 2D 
through 2H; 

Appendix D is a computer listing comprising a preferred implementation of a portion of the apparatus of 
Fig. 1B; and 

Appendix E is a computer listing comprising a preferred implementation of a portion of the apparatus of 
Fig. 1B 

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 

Reference is now made to Fig. 1 A which is a simplified pictorial illustration of a preferred embodiment of 
handwriting recognition apparatus constructed and operated in accordance with the present invention. A digi- 
tizing pen/accelerometer 10 is employed to write on a graphic tablet 12. 

Pen 1 0 also comprises a built-in accelerometer 25, such as model ICS 3031 -2 commercially available from 
IC Sensors, 1701 McCarthy Blvd., Milpitas, CA 95035. Alternatively, pen 10 may comprise a plurality of accel- 
erometers, which accelerometers may or may not be orthogonally disposed. 

Pen 10 also comprises one or more amplifiers 30, associated with the one or more accelerometers 25. 
Fig. 2A is a schematic drawing of a preferred embodiment of amplifier 30 suitable for use in this application. 

Alternatively, pen 10 may be fitted with retrofittable apparatus comprising one or more accelerometers 
25 as described above, and also comprising associated amplifiers 30, as described above. The apparatus may 
have the form of a cap fitting the end of pen 10, a ring encircling the pen, or any other suitable form. 

Graphic tablet 1 2 senses the position of the tip of pen 10 relative to tablet 12 and provides a digitized output 
of data describing the position. Graphic tablet 12 may be any suitable graphic tablet, such as a Wacom Tablet 
Processor model SD-51 0C available from WACOM Computer Systems GmbH, Hellersbergstrasse 4, W-4040 
Neuss 1, Germany. 

The data from the one or more accelerometers in pen 10 is termed herein "accelerometer data". Acceler- 
ometer data and location data from graphic tablet 12 are each sent through separate cables to a control circuit 
40. Alternatively, the accelerometer data and location data may be sent through a single cable. According to 
a still further alternative, the accelerometer data and location data may be sent through any kind of appropriate 
communication link, such as ultrasonic, infrared, or by any other suitable means. 

Control circuit 40 amplifies the acceleration signals from pen 10 and converts them to digital form, pre- 
ferably using an analog to digital converter. Fig. 2B is a schematic drawing of a preferred embodiment of an 
analog to digital converter suitable for use in this application. 

Control circuit 40 then sends combined synchronized acceleration data and position data to an acceleration 
and position data processor 50. Data processor 50 may be any suitable computer, for example, an IBM PC 
compatible computer with an 80386 processor chip. 

Associated with data processor 50 are a symbol display 60 and an input device 70. Recognition occurs 
within data processor 50 and the recognized symbols are displayed on symbol display 60. If necessary, the 
user may enter corrections of recognition errors using input device 70. Alternatively, the user may enter cor- 
rections using pen 10 and digitizing tablet 12 to choose among alternatives displayed on the symbol display, 
or using other suitable means. 

The functionality of the apparatus of Fig. 1 A will now be described. The user employs pen 1 0 to write sym- 
bols on graphic tablet 12. Pen 10 sends acceleration data describing the accelerations of pen 10 during writing 
to control circuit 40. Graphic tablet 12 sends pen point position data describing the position over time of the 
point of pen 10 to control circuit 40. 

Control circuit 40 amplifies and digitizes the acceleration data. If the acceleration data and the position 
data are not synchronized in time, control circuit 40 synchronizes the acceleration and position data by match- 
ing pen status signals with acceleration data. Pen status signals are d scribed more fully below with reference 
to Fig. 4B. The combined synchroniz d data is sent by control circuit 40 to data processor 50. 

Alt rnatively, control circuit 40 may also comprise a processor and memory suitable for storing the com- 



8 



EP 0 666 543 A2 



bined synchronized data. In this cas , pen 10, graphic tablet 12, and control circuit 40 may be used to produce 
and store the combined synchronized data. Then, at a later time, the data is sent by control circuit 40 to data 
processor 50 in order for handwriting recognition to occur. 

Before handwriting recognition may occur, data processor 50 must create a database which comprises data 
about each symbol which may be recognized, specific to each person who uses the apparatus. The database 
is termed herein the per-person per-symbol database. 

During teaching, data processor 50 controls the creation of the per-person per-symbol database of hand* 
writing characteristics. The per-person per-symbol database comprises data for each person whose handwrit- 
ing is known to the system, describing one or more prototypes for each symbol. Each prototype comprises para- 
meters which describes the symbol as written by the person; the parameters are described in more detail below 
with reference to step 240. 

During teaching the user writes symbols from a pre-arranged script known to data processor 50, and the 
associated symbols appear on symbol display 60 during the writing. Preferably, the pre-arranged script con- 
tains several repetitions of each symbol. Preferably, based on the experience of the inventor, the symbols 
should occur in different parts of a word, such as beginning, middle, and end, throughout the pre-arranged 
script The functionality of data processor 50 during the teaching process is more fully described below with 
reference to Fig. 4A. 

During recognition, data processor 50 controls the recognition process which comprises choosing the cor- 
rect symbol code corresponding to the symbol that was written by the user, preferably, the recognition process 
also comprises choosing the correct word which was written by the user. The functionality of data processor 
50 during the recognition process is more fully described below with reference to Fig. 4B. 

Reference is now additionally made to Fig. 1B which is a simplified semi-pictorial semi-block diagram il- 
lustration of handwriting recognition apparatus constructed and operative in accordance with an alternative 
preferred embodiment of the present invention. The apparatus of Fig. 1B is substantially similar to the appa- 
ratus of Fig. 1 A, except as described below. 

In the apparatus of Fig. 1B, pen 10 writes on a writing surface 75, which may be a sheet of paper, a com- 
puter display screen, or any other suitable writing surface. 

In the case where writing surface 75 comprises a computer display screen, pen 10 may optionally be em- 
ployed to write without ink, so that pen 1 0 functions strictly as a data-input device for the associated computer. 
It is appreciated that pen 10 in this case is particularly suited to function generally as a data input and pointing 
device as well as functioning as described below for handwriting analysis. 

Pen 10 of Fig. 1B is similar to pen 10 of Fig. 1A and additionally comprises an ultrasonic transmitter 80, 
such as model MA40S3S commercially available from Murata Electronics, GMBH, Halbeinstrabe 21-23, D- 
8500, Nurnberg, Germany. Ultrasonic transmitter 80 may be mounted on the pen at a suitable location, such 
as near the tip. Alternatively, ultrasonic transmitter 80 may be retrofittable to the pen. Further alternatively, 
ultrasonic transmitter 80 may comprise a plurality of transmitters: 

A plurality of ultrasonic receivers 85, such as model MA40S3R commercially available from Murata Elec- 
tronics, GMBH, Halbeinstrabe 21-23, D-8500, Nurnberg, Germany, are located at predetermined positions in 
proximity to writing surface 75. In the case where writing surface 75 comprises a typical sheet of paper or a 
typical computer display screen, two ultrasonic receivers 85 are typically sufficient to determine the position 
of pen 10. In the case where writing surface 75 is large compared to a typical sheet of paper or a typical com- 
puter display screen, more than two receivers are preferred. 

In the case where two receivers 85 are employed, the line determined by the centers of the two receivers 
is preferably substantially parallel to the plane in which writing surface 75 largely lies. In the case where more 
than two receivers 85 are employed, the line determined by the centers of the receivers is preferably substan- 
tially located in a plane parallel to the plane in which writing surface 75 largely lies. 

The receivers 85 are preferably located relative to the writing surface 75 in such a way as to maximize 
the accuracy of measurement of the position of the pen. In the case of the MA40S3R receivers referred to 
above, the preferable minimum distance between each of the receivers 85 and the nearest portion of writing 
surface 75 is twenty centimeters, and the preferable maximum distance between each of the receivers 85 and 
the furthest portion of writing surface 75 is one meter. 

The receivers 85 typically have a preferred direction of reception; receivers 85 should preferably be di- 
rected in the general direction of the area in which pen 10 will be employed. Also, transmitter 80 typically has 
a preferred direction of transmission; pen 10 should preferably be employed so that the preferred direction of 
transmission of transmitter 80 will be toward receivers 85. 

A control circuit 90 periodically triggers ultrasonic transmitter 80, accumulates data from ultrasonic receiv- 
ers 85, and calculates position of pen 10 based on the accumulated data. Control circuit 90 comprises a digital 
signal processor, known herein as a "DSP", such as model ADSP 2101 commercially available from Analog 
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Devices, One Technology Way, P.O.B.9106, Norwood, MA 02062-91 06, USA. 

Control circuit 90 also comprises a plurality of digital counters operatively associated with the plurality of 
ultrasonic receivers 85. A suitable count r is model 74HCT4040 commercially available from RCA GMBH, Ri- 
dierstrasse 35A, 8000 Munchen 2, Germany. Control circuit 90 further comprises appropriate memory units 
5 for data storage and program storage. 

Control circuit 90 also amplifies and digitizes the acceleration data. Control circuit 90 amplifies the accel- 
eration signals from pen 10 and converts them to digital form, preferably using an analog to digital converter. 
Fig. 2B is a schematic drawing of a preferred embodiment of an analog to digital converter suitable for use in 
this application. 

10 The functionality of the apparatus of Fig. 1B will now be described. The user employs pen 10 to write sym- 

bols on writing surface 75. Pen 10 sends acceleration data describing the accelerations of pen 1 0 during writing 
to control circuit 90. 

Control circuit 90 sends signals to pen 1 0, triggering ultrasonic transmitter 80 to emit a sequence of pulses. 
Typically, control circuit 90 sends a burst of pulses, each burst separated from the next burst by a specific 
15 time period. Preferably, four closely spaced pulses are sent in each burst, and the bursts are separated by 25 
microseconds. Reference is now additionally made to Fig. 2C, which is a schematic drawing of a preferred 
structure of the portion of control circuit 90 which sends signals to pen 10. 

Control circuit 90 restarts the counters included therein at the beginning of each burst. Each of the ultra- 
sonic receivers 85 receives the ultrasonic sound waves emitted by ultrasonic transmitter 80 as part of the burst, 
20 and sends a signal to control circuit 90. Upon receipt of a signal from one of the ultrasonic receivers 85, control 
circuit 90 stops the associated counter. Reference is now additionally made to Figs. 2D through 2H, which are 
schematic drawings of a preferred structure of the portion of control circuit 90 comprising the counters, DSP, 
and associated electronic circuits. 

Appendix C is a computer listing comprising a listing in the PALASM computer language of a preferred 
25 implementation of the apparatus of Figs. 2D through 2H. 

Appendix D comprises a computer listing of a preferred implementation of the method of accumulating ul- 
trasound data described above, in the language of the ADSP 2101 DSP mentioned above. 

Control circuit 90, in parallel with the other operations carried out by control circuit 90, calculates the co- 
ordinates of the tip of pen 10 based on the values in the counters within the control circuit. Control circuit 90 
30 filters the counter's signals by removing large jumps in the counter value between one burst and the next; typ- 
ically, jumps exceeding 25 to 30 units on the counter are considered large. 

When a large jump comprising a single data point is detected by control circuit 90, the value of the point 
is recomputed as the average of the previous and next values. When a large jump comprises two data points, 
control circuit 90 recomputes the values using linear interpolation. When a large jump comprises more than 
35 two data points, control circuit 90 recomputes the values of the points after the jump by subtracting the height 
of the jump, measured over the preceding data points. 

Control circuit 90 removes quantization noise of the counters. When a jump of one unit on the counter com- 
prising a single data point is detected, control circuit 90 recomputes the value of that data point using a zero 
order interpolation, giving the data point a value equal to that of the preceding and following data points. 
^0 Control circuit 90 then computes the position of the tip of pen 10 using triangulation as follows. The counter 

value represents the time between the transmission of a pulse by ultrasonic transmitter 80 and the receipt of 
the pulse by the one of ultrasonic receivers 85 associated with the counter. Because the speed of sound in air 
is taken to be isotropic, the counter value also represents the distance between ultrasonic transmitter 80 and 
the one of ultrasonic receivers 85 associated with the counter. The position of pen 10 is then computed by 
45 applying the Pythagorean theorem. 

Control circuit 90 then filters the signals using a low-pass filter, such as that described in Digital Filter De- 
sign by T.W. Parks and C.S. Burrus, published by John Wiley & Sons, 1987, chapter 7, section 7.3.3. using 
the fourth order low pass digital filter with cut-off frequency of 0.03. 

Appendix E is a computer listing written in the C programming language comprising a preferred implemen- 
50 tation of the method for computing position from ultrasound data as described above. 

The position data thus computed by control circuit 90 may comprise the position data used subsequently 
by the apparatus of Fig. 1B. Alternatively, as described below, position data may be computed from a com- 
bination of data received by ultrasonic receivers 85 and acceleration data. 

Control circuit 90 amplifies and digitizes the acceleration data. If th acceleration data and the position 
55 data are not synchronized in time, control circuit 90 synchronizes th acceleration and position data by match- 
ing pen status signals with acceleration data. Pen status signals are described more fully below with reference 
to Fig. 4B. The combined synchronized data is sent by control circuit 90 to data processor 50. 

Alternatively, control circuit 90 may also comprise a processor and memory suitable for storing th com- 
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bined synchronized data. In this case, pen 10 and control circuit 90 may be used to produce and store th com- 
bined synchronized data. Then, at a later time, the data is sent by control circuit 90 to data processor 50 in 
order for handwriting recognition to occur. 

In the case described above in which data from ultrasonic receivers 85 is combined with acceleration data 
5 to obtain position data, the improved position data is computed by data processor 50. Alternatively, the new 
position data may be computed by the DSP described above with reference to control circuit 90, 

Data processor 50 filters the position data from control circuit 90 to remove components other than noise. 
For example, the acceleration data may be filtered by a Butterworth digital filter described in Digital Filter De- 
sign by T.W. Parks and C.S Burrus, published by John Wiley & Sons, 1987, chapter 7, section 7.3.3, using the 
10 4th order lowpass digital filter with cut-off frequency of 0.7 to 0.9. 

The noise component is generated when pen 10, being moved by the user, is moved over irregularities in 
writing surface 75, including microscopic irregularities. In the case of most writing surfaces 75, such as for ex- 
ample a sheet of paper, the microscopic surface irregularities occur at regular intervals over surface 75. The 
number of peaks in the noise component is taken to represent the number of surface irregularities traversed, 
15 and hence the distance traversed. 

Data processor 50 identifies and counts peaks in the noise. The number of peaks per unit of distance may 
be determined in advance for the particular type of writing surface 75, may be determined by a learning proc- 
ess, or may be determined by other means. 

The positions determined by control circuit 90 from ultrasound data are taken to specify the direction f 
20 movement, and the number of peaks in the noise component as described above are taken to specify the dis- 
tance traversed. Data processor 50 computes, from the direction of movement and the distance traversed, 
updated and more accurate position data. Preferably, the sample rate of the acceleration data used to compute 
the noise is greater than the data transmission rate of ultrasound data from control circuit 90. 

Before handwriting recognition may occur, data processor 50 must create a database which comprises data 
25 about each symbol which may be recognized, specific to each person who uses the apparatus. The database 
is termed herein the per-person per-symbol database. 

During teaching, data processor 50 controls the creation of the per-person per-symbol database of hand- 
writing characteristics. The per-person per-symbol database comprises data for each person whose handwrit- 
ing is known to the system, describing one or more prototypes for each symbol. Each prototype comprises para- 
30 meters which describes the symbol as written by the person; the parameters are described in more detail below 
with reference to step 240. 

During teaching the user writes symbols from a pre-arranged script known to data processor 50, and the 
associated symbols appear on symbol display 60 during the writing. Preferably, the pre-arranged script con- 
tains several repetitions of each symbol. Preferably, based on the experience of the inventor, the symbols 
35 should occur in different parts of a word, such as beginning, middle, and end, throughout the pre-arrang d 
script The functionality of data processor 50 during the teaching process is more fully described below with 
reference to Fig. 4 A. 

During recognition, data processor 50 controls the recognition process which comprises choosing the cor- 
rect symbol code corresponding to the symbol that was written by the user; preferably, the recognition process 
40 also comprises choosing the correct word which was written by the user. The functionality of data processor 
50 during the recognition process is more fully described below with reference to Fig. 4B. 

Reference is now additionally made to Fig. 3 which is a simplified block diagram of the handwriting rec- 
ognition apparatus of Figs. 1A and 1B. The handwriting recognition apparatus of Fig. 3 receives input from 
pen 10 and either graphic tablet 12 or control circuit 90. The data from either graphic tablet 12 or control circuit 
45 90, representing positions of pen 10, is referred to herein as "position data". 

Pen 10. when moved by the user of the handwriting recognition apparatus, transmits data describing the 
accelerations of pen 10 overtime to teaching control 130 and/or handwriting recognition control 150. Pen 10 
also provides, in conjunction with graphic tablet 12, data describing the positions traced out over time by the 
tip of pen 10 as pen 10 is moved by the user over the surface of graphic tablet 12. Alternatively, in the cas 
so of the apparatus of Fig. 1 B, position data is provided by control circuit 90 as described above. 

The data from pen 10 and the position data may be transmitted to a teaching control 130. Transmission 
to teaching control 130 occurs for each person who is to use the system for handwriting recognition before the 
person uses the system for handwriting recognition for the first time. Transmission to teaching control 130 also 
occurs when recognition errors are detected; use of teaching control 130 when recognition errors are detected 
55 is termed herein adaptive teaching. 

Teaching control 130 operates on the data received, which data represents hand movements by the user 
when writing a symbol, together with manually-provided identification of the symbol codes that are associated 
with the data. Teaching control 130 then updates database 140, th per-person per-symbol database. Data- 
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bas 140 comprises prototypes of accelerations and symbol shape for each symbol, comprising data specific 
to each person for each symbol. 

Alternatively, the data from p n 10 and the position data may be transmitted to handwriting recognition 
control 150. Handwriting recognition control 150 operates on the data received from pen 10 and the position 
data to recognize the symbol represented by the movement of pen 10 on graphic tablet 12 or writing surface 
75. The output of handwriting recognition control 150 comprises a list of symbol codes and their respective 
probabilities. 

A handwriting recognition post-processing circuit 160, chooses the correct symbol code based on the list 
of symbol codes and probabilities, and on post-processing information which preferably comprises a database 
of previous confusions and a dictionary. The output of handwriting recognition post-processing circuit 160 is 
a symbol code or a word. 

Reference is now additionally made to Figs. 4A and 4B which are simplified flow charts illustrating oper- 
ation of the handwriting recognition apparatus of Figs. 1Aand 1B in accordance with a preferred embodiment 
of the invention. Fig. 4A illustrates the teaching process and Fig. 4B illustrates the recognition process. 

The preferred method of operation of the method of Fig. 4A includes the following steps: 

STEP 210: Read position data and accelerometer data in parallel. Preferably, the accelerometer data is 
sampled more often than the position data; for example, eight data points may be collected from the acceler- 
ometer for each data point in the position data. 

The combined data preferably comprises the X,Y coordinates of the position of the tip of the pen 10 in the 
grid of the tablet and the tablet contact status of pen 1 0, i.e. whether or not it is in contact with the tablet surface. 
The status may be operationally indicated as "pen up", "pen down", or "pen out of proximity with the tablet", 
in the case of the Wacom Tablet Processor specified above. The combined data also preferably comprises the 
average value of the accelerometer data points corresponding to a single graphic tablet data point. The status 
of pen 10 may be derived from signals transmitted by graphic tablet 12, by a switch operatively associated 
with the tip of pen 10, as described below with reference to step 212, or by other means. 

STEP 212: Identify pen-surface contact termination. The data from step 210 may not include the surface 
contact status of pen 1 0. In this case, the surface contact status of pen 1 0 may be derived from the acceleration 
data. The acceleration data is filtered to remove components other than noise. For example, the acceleration 
data is filtered by a Butterworth digital filter described in Digital Filter Design by T.W. Parks and C.S Burrus, 
published by John Wiley & Sons, 1987, chapter 7, section 7.3.3, using the 4th order lowpass digital filter with 
cut-off frequency of 0.7 to 0.9. 

The filtered acceleration data is then integrated overtime. The slope of the integrated filtered acceleration 
data is then analyzed to determine the point at which the slope exceeds a threshold value. The point at which 
the slope exceeds the threshold value is taken to be the first point with status "pen down". The point at which 
the slope falls below a threshold value is taken to be the first point with status "pen up"; the threshold value 
may or may not be the same as the previously described threshold value. In the case of determining pen status 
based on accelerometer data there is no status "pen out of proximity". 

The threshold values described above may be determined in advance for the particular type of pen and 
writing surface, may be determined by a learning process for the particular person, or may be determined by 
other means. 

STEP 215: Identify individual symbols and words. The data from the previous step is divided into data rep- 
resenting individual symbols. The status which comprises the statuses of "pen up" or "pen out of proximity" is 
termed herein "pen not down". Preferably, the number of consecutive data points with status of "pen not down", 
which data points represent a particular duration of the status "pen not down", is taken to indicate the end of 
a symbol or of a word. 

Typically, the duration of status "pen not down" within a range from 200 milliseconds to 400 milliseconds 
is taken to indicate the end of a symbol. Duration of the status "pen not down" in the range from 800 milliseconds 
to 1200 milliseconds is typically taken to indicate the end of a word. 

Alternatively, the end of a symbol or of a word may be indicated by data points which represent pen move- 
ments that are not part of a symbol, or by other means. Output data from step 215 comprises symbol end and 
word end data. 

STEP 220: Normalize combined data. The combined position data and the accelerometer data are nor- 
malized in time or by other means. 

Appendix A is a computer listing in the C programing language comprising routines that are a preferred 
implementation of step 220. The routines comprise th following routines in section II, "pre-preprocessing": 
normal; together with various definitions used by routine normal. 

STEP 230: Filter combined data. The normalized combined data received from th previous step is filtered 
in order to remove noise. The filtering may be accomplished by iterative smoothing of adjacent points until the 
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total change in the signal due to a smoothing operation is less than the desired accuracy of the data, or by 
other suitable means. 

STEP 240: Parameterize combined data. The data is parameterized according to criteria which are chosen 
to r present each symbol. Reference is now additionally made to Figs. 5A through 5D which graphically illus- 
5 trate some of the parameters. 

If the pen comprises a single accelerometer, the parameters preferably comprise the following: 
number of points before normalization; 
normalized signal of pen status; 
normalized signal of accelerations; 
10 sine of the angle a which angle is defined as the angle between the vector associated with the current 

data point (X,,Y,,AccZ,) and the XY plane as shown in Fig. 5A; 
cosine of the angle a; 

sine of the angle p which angle is defined as the angle between the vector that connects the point before 
the previous point (Xp-z.Yj. 2f AccZ^ 2) and the current point (X i , Y, AccZ,), and the vector that connects the current 
point with the point after the subsequent point (X^.Y^AccZna) in space (X,Y,AccZ) as shown in Fig. 5B; 
and cosine of the angle p. 

Alternatively, the pen may comprise, for example, three accelerometers, which are not necessarily mutu- 
ally orthogonal. If the accelerometers are not mutually orthogonal, the acceleration data may be converted into 
equivalent data in a mutually orthogonal coordinate system as follows: 

Let the non-orthogonal signals be denoted by the vector u=(u 1f u 2 ,u 3 ) T and the orthogonal signals be de- 
noted by the vector u'^u'., m 9 2 m'$\ where T denotes the transpose. Then u'=AoA-iu where A is a vector of static 
sensitivity vectors A=(A 1 ,A 2i A 3 ) of the three accelerometers. The static sensitivity vector is computed from th 
^ outputs of the accelerometers during a defined orientation without movement. Aq is a diagonalized matrix of 
0 sensitivity of the orthogonal coordinate system comprising the norms of A lt A 2 , and A 3 . 

When the pen comprises, for example, three accelerometers, the parameters preferably comprise those 
mentioned above plus the following parameters: 

sine of the angle a' which angle is defined as the angle between the vector associated with the current 
data point (AccXi.AccY^AccZt) and the AccXAccY plane as shown in Fig. 5C; 
cosine of the angle a'; 

sine of the angle p' which angle is defined as the angle between the vector that connects the point before 
the previous data point (AccX^.AccY^.AccZ,. 2) and the current point (AccX, f AccY,,AccZO. and the vector that 
connects the current point with the point after the subsequent point (AccX^AccY^AccZhJ j n space 
(AccX,AccY f AccZ) as shown in Fig. 5D; 
and cosine of the angle p\ 
STEP 250: Generalize parameters. The parameters of the symbol being learned represent a specific in- 
stance of the symbol. The symbol prototype stored by the system is to represent the general characteristics 
of the symbol as drawn by that person. Therefore, the parameters of the symbol being learned are generalized 
by some suitable means, such as by computation of the average of the value of each parameter from previous 
instances of the symbol along with the value of each parameter from the current instance of the symbol. 

STEP 260: Update per-person per-symbol prototype database. The newly computed parameters from th 
previous step are stored in the per-person per-symbol prototype database. 

The preferred method of Fig. 4B includes steps which have been described as part of the description of 
Fig. 4A. Description of those steps which are identical to steps in Fig. 4A have been omitted for the sake of 
brevity. The remainder of the steps in Fig. 4B include the following: 

STEP 300: For each prototype in the per-person per-symbol prototype database, build an index of com- 
parison between the sample and the prototype, combined over parameters in the prototype. In accordance 
with one preferred embodiment of the present invention, all parameters are combined together to produce the 
index of comparison. Appendix A is a computer listing in the C programing language comprising routines that 
are a preferred implementation of step 300. The routines comprise the following, which are found in section 
V, "symbols recognition": make_corr; correl_hem; obLfunct; together with various definitions used by the rou- 
tines. 

In accordance with another preferred embodiment of the present invention, parameters which come from 
graphic tablet data are combined and compared together, and parameters from accelerometer data are sep- 
arately combined and compared, thus producing two measures of comparison between the sample and the 
prototype. Appendix B is a computer listing in the C programing language comprising routines that are a pre- 
ferred implementation of step 300. The routines comprise the following, which are found in section IV, "recog- 
nition procedures": def_k_class; def_k_letten def_k_word; def_k_row; mut_metric; metric_dir_y; metric_dir_x; 
together with various definitions used by the routines. 
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STEP 31 0: Create a list or lists of probable symbols sorted by likelihood. Bas d on the index or indices of 
comparison generated in step 300, a single list of probable symbols sorted by lik lihood is generated according 
to one preferred embodiment of the present invention. 

According to another pr ferred embodiment of the present invention, two separate lists of probable sym- 
bols sorted by likelihood are generated. When two separate lists are generated, one comprises likely symbols 
based on graphic tablet data and the other comprises likely symbols based on accelerometer data. Appendix 
B is a computer listing in the C programing language comprising routines that are a preferred implementation 
of step 310. The routines comprise the following, which are found in section IV, "recognition procedures": main 
of subsection "sort out"; sort_a; sort_b; sort_c; sort; checkjnap; read_map; rmatr; add_metric; sort_add; to- 
gether with various definitions used by the routines. 

STEP 320: Choose the correct symbols and the correct word based on the list or lists, the database of 
previous confusions and a dictionary. If one list was generated previously, the symbols with greatest likelihood 
are the candidates from which the correct symbol is chosen. 

If more than one list was generated, the lists are combined and symbols with high likelihood on the com- 
bined list are the candidates from which the correct symbol is chosen. Preferably, the lists may be combined 
by a voting procedure which first forms the intersection of the two lists. Appendix B is a computer listing in the 
C programing language comprising routines that are a preferred implementation of step 320. The routines com- 
prise those routines found in the section entitled "combined results from graphic tablet and accelerations rec- 
ognition", together with various definitions used by the routines. 

If the intersection of the two lists is empty, so that no symbol appears in both lists, the output is the list 
which was produced from the position data. If the intersection is not empty, so that at least one symbol appears 
In both lists, the output list comprises all symbols included in the intersection group of the two input lists, sorted 
according to the average of the probabilities contained in the two lists. 

The database of previous confusions provides information that allows the correction of the choice of the 
correct symbol based on previous incorrect identifications. The database of previous confusions comprises, 
for each symbol, a list of other symbols which have been confused with the first symbol; for example, that the 
symbol T has often been confused with the symbol "b". When such an entry is found comprising previous 
confusions for a symbol in the list, the symbol or symbols that have previously been confused with the symbol 
in the list are added to the list. In accordance with the previous example, if the symbol T is found in the list, 
then the symbol "b" is added to the list. 

An indication of the end of each word has been passed as output since step 215, described above. Based 
on the indication, the most likely word, comprising the most likely identifications for each symbol in the list, is 
identified. 

The most likely word is checked against the dictionary. Preferably, the dictionary comprises both a general 
dictionary used for all users of the system and a personal dictionary for each user of the system. If an entry 
exists in the dictionary for the most likely word, the word is chosen as the correct identification. 

If the most likely word is not found in the dictionary, all possible word combinations in the list are formed 
and each is checked against the dictionary. Among all such words which are found in the dictionary, the word 
with the highest likelihood is then chosen as the correct identification. 

If none of the words is found in the dictionary, the most likely word is chosen as the correct identification. 

STEP 330: Check to see if a correction has been entered. During the process of recognition, the user of 
the system is preferably provided with a visual indication of each symbol recognized. 

After the end of a word is detected, the user of the system preferably is provided with a visual indication 
of the word recognized. The user may indicate manually that a given word was incorrectly recognized and may 
input a correction. 

STEP 340: Update database of previous confusions. Based on a manual correction entered in step 330 
or an automatic correction based on the dictionary, the database of previous confusions is updated. Based 
on a manual correction, the personal dictionary is also updated if the corrected word is not found in the dic- 
tionary. 

Reference is now additionally made to Fig. 6A which is a simplified illustration of a preferred mechanical 
structure of the digitizing pen/accelerometer 10 of Fig. 1A. Pen 10 may comprise an electromagnetic pen such 
as a WACOM SP-200 available from WACOM Computer Systems GmbH, Hellersb rgstrasse 4, W-4040 Neuss 
1, Germany, or any other suitable pen designed for use with a suitable model of graphic tablet Pen 10 also 
comprises an electromagnetic coil 410 which operates in conjunction with graphic tablet 12 to provide and in- 
dication of the location of the point of pen 10. Pen 10 further comprises an ink refill 420 which provides th 
ability to write on pap r or on another surface. 

Pen 10 also compris s three built-in mutually orthogonal accelerometers 25 such as ICS 3031-2 available 
from IC Sensors. Alternatively, there may be a plurality of acc lerometers not n cessarily orthogonally dis- 
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pos d. According to a still further alternative, there may be only one accel rometer. 

Pen 1 0 also comprises associated amplifiers 30, described above with reference to Fig. 1 A. Pen 1 0 further 
comprises communications cable 450 which is used to send data to control circuit 40. Alternatively, the data 
may be s nt thr ugh any kind of appropriate communication link, such as ultrasonic, infrared, or by any other 
5 suitable means. 

Reference is now additionally made to Fig. 6B which is a simplified illustration of a preferred mechanical 
structure of the digitizing pen/accelerometer 10 of Fig. 1B. Pen 10 may comprise a housing such as an ABS 
plastic housing or other suitable housing. Pen 1 0f urther comprises an ink refill 420 and associated spring which 
provides the ability to write on paper or on another surface. 
10 Pen 1 0 also comprises three built-in mutually orthogonal acceterometers 25 such as ICS 3031 -2 available 

from IC Sensors. Alternatively, there may be a plurality of accelerometers not necessarily orthogonally dis- 
posed. According to a still further alternative, there may be only one accelerometer. 

Pen 10 also comprises associated amplifiers 30, described above with reference to Fig. 1 A 

Pen 10 also comprises ultrasonic transmitter 80 as specified above. Pen 10 further comprises communi- 
15 cations cable 450 which is used to send data to control circuit 90. Alternatively, the data may be sent through 
any kind of appropriate communication link, such as ultrasonic, infrared, or by any other suitable means. 

Reference is now made to Fig. 7 which is a simplified pictorial illustration of another alternative preferred 
embodiment of handwriting recognition apparatus constructed and operated in accordance with the present 
invention. Pen 10 is employed to write in a notebook, on a sheet of paper, or on any other suitable surface. In 
20 the apparatus of Fig. 7, Pen 10 is as described above but the one or more accelerometers 25 comprise a plur- 
ality of accelerometers. 

The apparatus of Fig. 7 includes a scanner 500, such as a Logitech ScanMan, model 256. The user writes 
with pen 10 on writing surface 512. The description above in reference to Fig. 1 also applies to Fig. 7, except 
as described herein with reference to Fig. 7. 
25 Pen 1 0 sends acceleration data through control circuit 40 to data processor 50. After writing is concluded, 

surface 512 is scanned using scanner 500. Teaching and recognition then occur based on the combined data 
from pen 10 and scanner 500. 

Reference is now additionally made to Fig. 8 which is a simplified block diagram of the handwriting rec- 
ognition apparatus of Fig. 7. The handwriting recognition apparatus of Fig. 8 receives input from pen 10 and 
30 scanner 500. 

Pen 10, when moved by the user of the handwriting recognition apparatus, transmits data describing the 
accelerations of pen 10 over time to acceleration teaching control 630 and/or acceleration handwriting recog- 
nition control 650. 

The term OCR as used herein refers to optical character recognition. Scanner 500, when it scans writing 
35 surface 512, transmit data describing the image on surface 512 to OCR teaching control 635 and/or OCR con- 
trol 655. 

The data from pen 10 and scanner 500 may be transmitted to acceleration teaching control 630 or OCR 
teaching control 635 respectively. Transmission to acceleration teaching control 630 or OCR teaching control 
635 occurs for each person who is to use the system for handwriting recognition before the person uses the 
40 system for handwriting recognition for the first time. Transmission to acceleration teaching control 630 or OCR 
teaching control 635 also occurs when recognition errors are detected; use of acceleration teaching control 
630 or OCR teaching control 635 when recognition errors are detected is termed herein adaptive teaching. 

Acceleration teaching control 630 or OCR teaching control 635 operates on the data received, which data 
represents hand movements by the user when writing a symbol, together with manually-provided identification 
45 of the symbol codes that are associated with the data. Acceleration teaching control 630 then updates database 
640, a per-person per-symbol acceleration database; OCR teaching control 635 updates database 645, a per- 
person per-symbol OCR database. Database 640 and database 645 comprise prototypes of accelerations and 
symbol shape for each symbol, comprising data specific to each person for each symbol. 

Alternatively, the data from pen 10 and scanner 500 may be transmitted to acceleration handwriting rec- 
so ognition control 650 or OCR control 655 respectively. Acceleration handwriting recognition control 650 and 
OCR control 655 operate on the data received from pen 10 and scanner 500 respectively to recognize the sym- 
bol represented by the movement of pen 10 on scanner 500. 

The output of acceleration handwriting recognition control 650 comprises a list of symbol codes and their 
respective probabilities. An acceleration handwriting recognition post-processing circuit 660, chooses the cor- 
55 rect symbol code based on the list of symbol codes and probabilities, and on post-processing information which 
preferably compris s a database of previous confusions and a dictionary. The output of acceleration hand- 
writing recognition post-processing circuit 660 is a list of symbol codes and/or words sorted by likelihood. 

Recognized word storage circuit 670 stores, for each word recognized, the sorted list of likely words output 
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by acceleration handwriting recognition post-processing circuit 660. The stored lists are kept for later process- 
ing. 

The output of OCR control 655 comprises, for each symbol in the scanned image from scanner 500, a list 
of probable symbol codes sorted by likelihood. OCR control 655 may be implemented, for example, by any 
appropriate commercially available OCR system. 

Word/string matcher 680 accepts as input the lists of words output by acceleration handwriting recognition 
post-processing circuit 660 and the list of probably symbol codes output by OCR control 655. Word/string 
matcher 680 finds matches between its two input lists. The output of word/string matcher 680 comprises a list 
of words and/or strings of symbols and the position of each word and/or string on writing surface 512. 

Reference is now additionally made to Figs. 9A and 9B which are simplified flow charts illustrating oper- 
ation of the handwriting recognition apparatus of Fig. 7 in accordance with a preferred embodiment of the in- 
vention. Fig. 9A illustrates the teaching process and Fig. 9B illustrates the recognition process. 

The preferred method of Fig. 9A includes steps which have been described as part of the description of 
Fig. 4A. Description of those steps which are identical to steps in Fig. 4A have been omitted for the sake of 
brevity. The remainder of the steps in Fig. 9A include the following: 

STEP 710: Read accelerometer data. The accelerometer data comprises data points representing sam- 
pling of the acceleration measured by accelerometers 25. Preferably, the sampling rate is approximately 1600 
data points per second, averaged over 8 points, producing an output of approximately 200 data points per sec- 
ond. 

STEP 712: Identify pen-surface contact termination. The data from step 710 does not include the surface 
contact status of pen 10. The surface contact status of pen 10 may be derived from the acceleration data, as 
explained in step 212 above with reference to tablet contact data. 

STEP 715: Identify individual symbols and words. The data from the previous step is divided into data rep- 
resenting individual symbols. The status which comprises the status of "pen up" is termed herein "pen not 
down*. Preferably, the number of consecutive data points with status of "pen not down", which data points rep- 
resent a particular duration of the status "pen not down", is taken to indicate the end of a symbol or of a word. 

Typically, the duration of status "pen not down" within a range from 200 milliseconds to 400 milliseconds 
is taken to indicate the end of a symbol. Duration of the status "pen not down" in the range from 800 milliseconds 
to 1200 milliseconds is typically taken to indicate the end of a word. 

Alternatively, the end of a symbol or of a word may be indicated by data points which represent pen move- 
ments that are not part of a symbol, or by other means. Output data from step 715 comprises symbol end and 
word end data. 

STEP 720: Normalize accelerometer data. The accelerometer data is normalized in time or by other means. 
Appendix A, previously described above in reference to step 220, is a computer listing in the C programing 
language comprising routines that are a preferred implementation of step 720. The routines comprise the fol- 
lowing routines in section II, "pre- preprocessing": normal; together with various definitions used by routine nor- 
mal. 

STEP 730: Filter accelerometer data. The normalized accelerometer data received from the previous step 
is filtered in order to remove noise. The filtering may be accomplished by iterative smoothing of adjacent points 
until the total change in the signal due to a smoothing operation is less than the desired accuracy of the data, 
or by other suitable means. 

STEP 740: Parameterize accelerometer data. The data is parameterized according to criteria which are 
chosen to represent each symbol. If the accelerometers are not mutually orthogonal, the acceleration data may 
be converted into equivalent data in a mutually orthogonal coordinate system as follows as described above 
with reference to step 240. 

The parameters preferably comprise the following: 
number of points before normalization; 
normalized signal of pen status; 
normalized signal of 2 acceleration; 

sine of the angle a ' defined above with reference to step 240; 
cosine of the angle a'; 

sine of the angle p* d fined above with reference to step 240; 
and cosine of the angle p\ 
STEP 760: Update per-person per-symbol acceleration prototype database. The newly computed para- 
meters from th previous st p are stored in the per-person per-symbol acceleration prototype database. 

STEP 770: Has the end of the predefined text been reached? Whether the end has been reached is de- 
termined by whether or not the end of the predefined text file has been reached. If not, the process continues 
with step 710. If the nd has been reached, the process continues with step 780. 
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STEP 780: Scan written text The text written on surface 512 is scanned using scanner 500. 

STEP 790: OCR teaching process. For each symbol in the text, features of the corresponding writing on 
surface 512 are id ntified. 

STEP 795: Update per-person per-symbol OCR prototype database. F atures identified in step 790 are 
5 updated in the per-person per-symbol OCR prototype database. 

The preferred method of Fig. 9B includes steps which have been described as part of the description of 
Figs. 4A and 9A. Description of those steps which are identical to steps in Figs. 4A and 9A have been omitted 
for the sake of brevity. The remainder of the steps in Fig. 9B include the following: 

STEP 800: For each prototype in the per-person per-symbol acceleration prototype database, build an in- 
to dex of comparison between the sample and the prototype, combined over parameters in the prototype. In ac- 
cordance with a preferred embodiment of the present invention, all parameters are combined together to pro- 
duce the index of comparison. Appendix A is a computer listing in the C programing language comprising rou- 
tines that are a preferred implementation of step 800. The routines comprise the following, which are found in 
section V, "symbols recognition": make_corr; correLhem; obj_funct; together with various definitions used by 
is the routines. 

STEP 810: Create a list of probable symbols sorted by likelihood. Based on the index or indices of com- 
parison generated in step 800, a single list of probable symbols sorted by likelihood is generated. 

STEP 820: Choose the correct symbols and the correct word based on the list, the database of previous 
confusions and a dictionary. The symbols with greatest likelihood are the candidates from which the correct 
20 symbol is chosen. 

As described above with reference to step 320, the database of previous confusions provides information 
that allows the correction of the choice of the correct symbol based on previous incorrect identifications. 

An indication of the end of each word has been passed as output since step 715, described above. Based 
on the indication, the most likely word, comprising the most likely identifications for each symbol in the list, is 
25 identified. 

The most likely word is checked against the dictionary. Preferably, the dictionary comprises both a general 
dictionary used for all users of the system and a personal dictionary for each user of the system. If an entry 
exists in the dictionary for the most likely word, the word is chosen as the correct identification. 

If the most likely word is not found in the dictionary, all possible word combinations in the list are formed 
30 and each is checked against the dictionary. Among all such words which are found in the dictionary, the word 
with the highest likelihood is then chosen as the correct identification. 

If none of the words is found in the dictionary, the most likely word is chosen as the correct identification. 

STEP 822: Store recognition information. The sorted list of likely words output by the previous step is stored 
for later processing. 

35 STEP 824: Check for end of text The user indicates end of text using input device 70. 

STEP 826: Scan written text. Scanner 500 is employed to scan writing surface 512. The scanned image 
is output to step 828. 

STEP 828: Perform OCR. OCR control 655 is employed to perform optical character recognition on the 
scanned image from the preceding step. The output of step 828 comprises, for each symbol in the scanned 
40 image from step 826, a list of probable symbol codes sorted by likelihood and the position of each symbol in 
the scanned image. OCR control 655 may be implemented, for example, by any appropriate commercially avail- 
able OCR system. 

STEP 830: Find matching words 

For each word from acceleration, find all exactly matching words in OCR and list them including location; 
45 or mark no match. 

For each word in the acceleration list where matches were found, succeeding words are checked to see 
whether the succeeding words correspond to words in succeeding locations as indicated from the OCR list; 
this process continues until no further match is found. There may be several possible matches for each word 
in the acceleration list. Further matching sequences of words are sought beginning with the next word after 
so the last word of the preceding list of matches. 

For each remaining unmatched word in the acceleration list, the closest matching word in the OCR list is 
identified based on some measure of variance. For example, the measure of variance may be the number of 
matching letters between the two words on the list, with a minimum of 2 letters matching. 

The regions adjacent to the partially matched words are then checked; if the region before and after are 
55 matched, then we decide that the partially matched words are matched. 

The unmatched words in the OCR list are now examined. For any remaining unmatched words, if the region 
before and after th word matches, the word is considered to match. 

Optionally, any other context sensitive methods such as grammar checking or other appropriate means 
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of identifying missing sections may b used to identify still unmatch d words. Any remaining unmatched words 
are identified manually by the user. 

STEP 840: Update database of pr vious confusions. Based on a manual correction entered in step 330 
or an automatic correction based on the dictionary, the database of previous confusions is updated. Based 
5 on a manual correction, the personal dictionary is also updated if the corrected word is not found in the dic- 
tionary. 

It is appreciated that the particular embodiment described in the Appendices is intended only to provide 
an extremely detailed disclosure of the present invention and is not intended to be limiting. 

It is appreciated that various features of the invention which are, for clarity, described in the contexts of 
10 separate embodiments may also be provided in combination in a single embodiment. Conversely, various fea- 
tures of the invention which are, for brevity, described in the context of a single embodiment may also be pro- 
vided separately or in any suitable subcombination. 

It will be appreciated by persons skilled in the art that the present invention is not limited to what has been 
particularly shown and described hereinabove. Rather, the scope of the present invention is defined only by 
15 the claims that follow: 
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" APPENDIX A 
Recognition according a combination of signals 



Definitions and data structures 
Pqard.H file 

r Function init_datatr ( portbase ) sets communication with data 
translation board via port portbase. It returns : 

0 - communication was established ; 
-1 - error on board (board is not exist). 7 
//int init_datatr ( int ) ; 

int newcomp ( void ) ; 

int read_ch ( int channel , int gain ) ; 

//int read_point ( struct point * , int ) ; 

/*int read_block ( struct point " , int max_numb_point , 

int timeout_for_begin , int timeout_for_end , 
int key_mouse_stop ) ; */ 

//int read_symboi ( struct point * , int , int ) ; 

int mshit ( void ) ; 

void close_datatr ( void ) ; 

^define PORT_BASE 0x210 

#define KEY.STOP 0x1 
^define MOUSE.STOP 0x2 
^define KEY_MOUSE_STOP 0x3 

^define PEN.WAIT 0x1 
tfdefine PEN_NOWAIT 0x0 



P3ta-H fi'fi 
struct point_pen 
45 { 

unsigned ax ; 
unsigned ay ; 
unsigned az ; 
unsigned pn ; 

50 } ; 

struct point_tablet 
{ 

int x ; 
int y ; 

55 int p ; 

} ; 

#defme SYNCROBIT 0x80 
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10 



50 



Datar.H file 

#define PORT_BASE 0x210 
#define CSR 0x0 
#define GAIN 0x1 
#define DAC0.LOW 0x2 
#define DACO_HIGH 0x3 
^define DACl.LOW 0x4 
#define DAC1_HIGH 0x5 



#define CHANNEL.AX 0x4 
#define CHANNEL.AY 0x5 
#define CHANNEL.AZ 0x6 
#define CHANNEL.PN 0x7 
« #define STATUS Oxe 

#define CHANNEL_EM PTY 0x0 

#define IDREGISTER Oxf 

20 #define GAIN_1 0x00 

#defme GAIN.2 0x40 

#define GAIN_4 0x80 

#define GAIN 8 OxcO 



25 


#define IER 


0x21 




#define MR 


0x20 




#define IRQO 


0x08 




#define 1RQ1 


0x09 


30 


#define IRQ2 


OxOa 




#define IRQ3 


OxOb 




#deflne IRQ4 


OxOc 




#deftne IRQ5 


OxOd 




#define IRQ6 


OxOe 


35 


#define IRQ7 


OxOf 




/*struct point { 





unsigned ax ; 
unsigned ay ; 
40 unsigned az ; 

unsigned pn r 
};*/ 

#define MINUS_PEN 1700 
/*#define PENJJP 0x2 
45 #define PEN_DOWN 0x4 

#define PEN_THRSLD 200 
#define EMPTY 0 



#define BUFSI2E 0x80 



#define TIME.COUNT 3000 
#include <dos.h> 



55 



20 



EP 0 666 543 A2 



Ser.H file 

/* : * 

FILENAME: 3ERIAL.H 

Some definitions used by SER.C 

#define COM1 1 

#define COM2 2 

^define COM 1 BASE 0. 2F3 r Base port address for COM1 */ 

tfdefine COM2BASE 0x2=3 r Base port address for COM2 V 

r 

The 8250 UART has 10 registers accessible through 7 port addresses. 
Here are their addresses relative to COM1BASE and COM2BASE. Note 
that the baud rate registers. (DLL) and (DLH) are active only when 
the Divisor-Latch Access-Bit (DLAB) is on. The (DLAB) is bit 7 of 
the (LCR). 

o TXR Output data to the serial port. 

o RXR Input data from the serial port. 

o LCR Initialize the serial port. 

o IER Controls interrupt generation. 

o MR Identifies interrupts. 

o MCR Send contort signals to the modem. 

o LSR Monitor the status of the serial port. 

o MSR Receive status of the modem. 

o DLL Low byte of baud rate divisor. 

o DHH High byte of baud rate divisor. 

V 



frdefine TXR 


0 


r Transmit register (WRITE) */ 


^define RXR 


0 


/* Receive register 


(READ) V 


^define IER 


1 


r Interrupt Enable 


V 


^define II R 


2 


r Interrupt ID 


V 


#define LCR 


3 


r Line control 


V 


#deftne MCR 


4 


/*• Modem control 


V 


^define LSR 


5 


r Line Status 


V 


^define MSR 


6 


r Modem Status 


V 


^define DLL 


0 


/* Divisor Latch Low 


V 


^define DLH 


1 


/* Divisor latch High 


V 


/*- - 






* 



Bit values held in the Line Control Register (LCR). 
bit meaning 



0-1 00=5 bits..01=6 bits. 10=7 bits. 11=8 bits. 

2 Stop bits. 

3 0=parity off, 1=parity on. 

4 0=parity odd, 1=parity even. 

5 Sticky parity. 

6 Set break. 

7 Toggle port addresses. 

#define NO.PARITY OxCO 
^define EVEN_PARITY 0x13 
^define ODD_PARITY 0xC3 
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r 

Bit values held in the Line Status Register (LSR). 



bit 

0 
1 
2 
3 
4 
5 
6 
7 



meaning 



Data ready. 

Overrun error - Data register overwritten. 
Parity error • bad transmission. 
Framing error - No stop bit was found. 
Break detect - End to transmission requested. 
Transmitter holding register is empty. 
Transmitter shift register is empty. 
Time out - off Jine. 
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#define RCVRDY 


0x01 




#define OVRERR 


0x02 




#define PRTYERR 


0x04 




^define FRMERR 


0x08 




#define BRKERR 


0x10 


20 


#define XMTRDY 


0x20 




#define XMTRSR 


0x40 




^define TIMEOUT 





0x80 



25 



30 



35 



Bit values held in the Modem Output Control Register (MCR). 
bit meaning 



0 
1 
2 
3 



4 

5-7 



Data Terminal Ready. Computer ready to go. 
Request To Send. Computer wants to send data, 
auxiliary output #1 . 

auxiliary output #2.(Note: This bit must be 

set to allow the communications card to send 

interrupts to the system) 

UART ouput looped back as input. 

not used. 



#define DTR 0x01 
#define RTS 0x02 
#define MCJNT 



0x08 



40 



Bit values held in the Modem Input Status Register (MSR). 



bit 


meaning 


0 


delta Clear To Send. 


1 


delta Data Set Ready. 


2 


delta Ring Indicator. 


3 


delta Data Carrier Detect. 


4 


Clear To Send. 


5 


Data Set Ready. 


6 


Ring Indicator. 


7 


Data Carrier Detect. 



* ./ 

#define CTS 0x10 
#define DSR 0x20 
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Bit valu s held in the Interrupt Enable Register (IER). 
bit meaning 



0 Interrupt when data received. 

1 Interrupt when transmitter holding reg. empty. 

2 Interrupt when data reception error. 

3 Interrupt when change in modem status registe 
4-7 Not used. 

#define RXJNT 0x01 



Bit values held in the Interrupt Identification Register (MR), 
bit meaning 

0 Interrupt pending 

1-2 Interrupt ID code 

00=Change in modem status register, 
01=Transmitter holding register empty, 
10=Data received, 

1 1=reception error, or break encountered. 
3-7 Not used. 
* v 

#define RXJD 0x04 
#define RX_MASK 0x07 



r 

These are the port addresses of the 8259 Programmable Interrupt 
Controller (PIC). 

*/ 

#define IMR 0x21 r Interrupt Mask Register port V 

#define ICR 0x20 /* Interrupt Control Port 7 



/• 

An end of interrupt needs to be sent to the Control Port of 
the 8259 when a hardware interrupt ends. 

7 

#define EOI 0x20 /• End Of Interrupt V 



/* 

The (IMR) tells the (PIC) to service an interrupt only if it 
is not masked (FALSE). 

V 

#define IRQ3 0xF7 r COM2 7 

^define IRQ4 OxEF /* COM1 7 



r 

The (IMR) tells the (PIC) 
is not masked (FALSE). 

V 

#define IRQ3 0xF7 
#define IRQ4 OxEF 



to service an interrupt only if it 

/• COM2 7 
/* CCM1 V 
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int flag; 

int SetSerial(); 

int SetOthers(int Parity, int Bits, int StopBit); 
int SetSpeed(int Speed); 
int SetPort(int Port); 
void init_serial(void); 
void comm_off(void); 

void setallport(int Port, int Speed, int Parity, int Bits, int StopBit); 
int putchport (char); 
void putstrport(char *); 
int getchport(void); 
void offportQ; 



Serconst.H file 

r 

FILENAME: SERCONST.H 



The 8250 UART has 10 registers accessible through 7 port addresses. 
Here are their addresses relative to COM1 BASE and COM2BASE. Note 
that the baud rate registers, (DLL) and (DLH) are active only when 
the Divisor-Latch Access-Bit (DLAB) is on. The (DLAB) is bit 7 of 
the (LCR). 

o TXR Output data to the serial port. 

o RXR Input data from the serial port, 

o LCR Initialize the serial port. 

o IER Controls interrupt generation. 

o IIR Identifies interrupts. 

o MCR Send contort signals to the modem. 

o LSR Monitor the status of the serial port. 

o MSR Receive status of the modem. 

o DLL Low byte of baud rate divisor. 

o DHH High byte of baud rate divisor. 



Some definitions used by SER.C 



•V 



7 



#deflne 
#define 
#define 
#define 
#define 
#define 
#define 
#define 
#define 
#define 



TXR 

RXR 

IER 

IIR 

LCR 

MCR 

LSR 

MSR 

DLL 

DLH 



2 



1 



0 
1 



5 



3 



0 
0 



6 



4 



/* Transmit register (WRITE) V 
r Receive register (READ) V 

i* Interrupt Enable V 
Interrupt ID V 

/* Line control 7 
r Modem control 7 

/* Line Status 7 
/• Modem Status 7 

/* Divisor Latch Low 7 

/* Divisor latch High 7 



#define DLAB 0x80 /• V 

/ # 

Bit values held in the Line Control Register (LCR). 



bit meaning 
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0-1 00=5 bits. 01=6 bits, 10=7 bits, 1 1=8 bits. 

2 3iCD c::s. 

3 O-parrry off, 1=par;ty on. 

4 0=parity odd, 1=parity even. 

5 Sticky parity. 

6 Set break. 

7 Toggle port addresses. 

#define NO_PARITY OxOO 
#define EVEN^PARITY 0x1 S 
#define ODD_PARITY 0x08 

Bit values held in the Line Status Register (LSR). 
bit meaning 

0 Data ready. 

1 Overrun error - Data register overwritten. 

2 Parity error - bad transmission. 

3 Framing error - No stop bit was found. 

4 Break detect - End to transmission requested. 

5 Transmitter holding register is empty. 

6 Transmitter shift register is empty. 

7 Time out - off line. 

* . */ 

#define RCVRDY 0x01 

#define OVRERR 0x02 

#define PRTYERR 0x04 

#define FRMERR 0x08 

#define BRKERR 0x10 

#define XMTRDY 0x20 

#define XMTRSR 0x40 
#define TIMEOUT 0x80 

/• — - — - 

Bit values held in the Modem Output Control Register (MCR). 
bit meaning 



0 Data Terminal Ready. Computer ready to go. 

1 Request To Send. Computer wants to send data. 

2 auxiliary output #1 . 

3 auxiliary output #2. (Note: This bit must be 
set to allow the communications card to send 
interrupts to the system) 

4 UART ouput looped back as input. 
5-7 not used. 

#define DTR 0x01 
#define RTS 0x02 
#define MC INT 0x08 ' 



/• * 

Bit values held in the Modem Input Status Register (MSR). 
bit meaning 
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0 delta Clear To Send. 

1 delta Data Set Ready. 

2 delta Ring Indicator. 

3 delta Data Carrier Detect. 

4 Clear To Send. 

5 Data Set Ready. 

6 Ring Indicator. 

7 Data Carrier Detect 

#define CTS 0x10 

#define DSR 0x20 



Bit values held in the Interrupt Enable Register (IER). 
bit meaning 



0 Interrupt when data received. 

1 Interrupt when transmitter holding reg. empty. 

2 Interrupt when data reception error. 

3 Interrupt when change in modem status register. 
4-7 Not used. 

*/ 



#define RX INT 0x01 



r- 

Bit values held in the Interrupt Identification Register (IIR). 
bit meaning 



0 Interrupt pending 

1-2 Interrupt ID code 

00=Change in modem status register, 
Ol=Transmitter holding register empty, 
10= Data received, 

1 1 ^reception error, or break encountered. 
3-7 Not used. 

• */ 

#define RXJD 0x04 
#define RX.MASK 0x07 



/• 

These are the port addresses of the 8259 Programmable Interrupt 
Controller (PIC). 

*/ 

#define IMR 0x21 /* Interrupt Mask Register port V 

#define ICR 0x20 /* Interrupt Control Port V 



/• 

An end of interrupt needs to be sent to the Control Port of 
the 8259 when a hardware interrupt ends. 

*/ 

#define EOI 0x20 /* End Of Interrupt */ 
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The (I MR) tells the (PIC) to service an interrupt only if it 
is not masked (FALSE). 

V 

/'unsigned char IRQ[8] = { -0x01 , -0x02 , -0x04 , -0x80 , 

-0x10 , -Ox */ 
#define IRQ3 0xF7 /* COM2 V 

#define IRQ4 OxEF r COM1 V 

int SerSetPortBase ( int , unsigned * ) ; 

int SerSetSpeed ( unsigned , long ) ; 

int SerSetBitsParityStopBit ( unsigned , int , int . int ) ; 

int SerPutChar ( unsigned , unsigned char ) ; 

int SerPutString ( unsigned , unsigned char * ) ; 

int SerlnitBuffer ( unsigned ) ; 

int SerGetChar ( unsigned ) ; 

int SerTestDSR ( unsigned ) ; 

int SerTestCTS ( unsigned ) ; 

r int flag; 
int SetSerialQ; 

int SetOthers(int Parity, int Bits, int StopBit); 
int SetSpeed(int Speed); 
int SetPort(int Port); 
void init_serial(void); 
void cornm_off(void); 

void setallport(int Port, int Speed, int Parity, int Bits, int StopBit); 
int putchport (char); 
void putstrport(char *); 
int getchport(void); 
void offportO: 
V 



#define I 
#define 1 
#define I 
#define ." 
#define " 
tfdefine * 
#define " 
#define " 
#define " 
#define " 
^define " 
#define " 
^define " 
#define " 
^define " 
#define " 
^define " 
#define " 
#deftne " 
#define " 
#define " 
^define " 
"define ' 



PEN.DOWN 1 
PEN_UP 
PEN.OUTPROX 

TBL_WACOMJI 2 
TBL.DATA.ASCII . 1 

TBL_DATA_BINARY 
TBL_MODE_STREAM 
TBL_M OD E_S WITCH.STREAM 
TBL_MODE_SUPRESSED 
TBL_MODE_POINT 
TBLJTYPE.ABSOLUTE C 
TBL_TYPE_:RELATIVE 
TB L_M I LLI METERS C 
TBLJNCHES 1 
TBL_ALWAYS_TRANSMIT_YES 
TBL_ALWAYS_TRANSMlT_NO 
TBL_BAUD_19200 
TBL_BAUD_9600 
TBL_BAUD_4800 
TBL_BAUD_2400 
TBL_BAUD_1200 
TBL_BAUD_600 
TBL_BAUD_300 



0 
1 



0 



3 
1 



1 



99 



1 
0 



7 
6 
5 
4 
3 
2 
1 



0 
0 



0 
3 



0 



1 



2 



27 



EP 0 666 543 A2 



#define T6L_BAUD_150 0 
#define TBL.PARITY_NONE 0 
#define TBL_PARITY_ODD 1 
#define TBL_PARITY_EVEN 2 
^define TBL.STOPBITS.1 0 
frdefine TBL.STOPBITS.2 1 
#define TBL.DSR_MONITOR.0FF 0 
fcdefine TBL_DSR_ MONITOR.ON 1 
#define TBL.DATALENGTH.7 0 
#define TBL_DATALENGTH_8 1 
#define TBL_TRANSFER_RATE_MAX 7 
#define TBL_TRANSFER_RATE_100 6 
#define TBL_TRANSFER_RATE_67 5 
#define TBL_TR AN S F ER_R ATE.50 4 
#define TBL_TRANSFER_RATE_20 3 
#define TBL_TRANSFER_RATE_1 0 2 
#define TBL.TRANS FER_RATE_5 1 
#define TBL_TRANSFER_RATE_1 0 
#define TBL_ORIGINLOG.UPPER.LEFT 1 
#define TBL_ORIGINLOG.LOWER.LEFT 0 
#define TB L.D ATA.TER M I NATO R.CR.L F 2 
#define TBL_DATA_TERMlNATOR.LF 1 
#deftne TBL.DATA_TERMINATOR.CR 0 



int read_point.tablet.pen ( unsigned , int , 

struct point.tablet * , struct point_pen *[8] ) 

int find_set_parameters_tablet ( int comport , unsigned *portbase ) ; 

int init_tablet ( int port , unsigned *portbase , int command_set , 

int data.format , int operation.mode , int origin.type 
int unit.mesure , int always.transmit , int speed , 
int parity , int stopbit , int dsr.monitor , 
int datalength , int transfer_rate , int origjog , 
int data.terminator , int max.x , int max_y ) ; 

void close_tablet ( unsigned portbase ) ; 
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I. Reading from device 
s /* This procedure reads synchronized data from the graphic tablet and accelerometers 

int read_point_tablet_pen ( unsigned portbase , int read_pen . 

struct point.tablet 'tablet , 
struct point pen pen[8] ) 

{ 

10 int ind_package = 0 , reply , debug[10] , i ; 

unsigned char package[7] = {0.0,0,0.0,0,0}; 
if ( read_pen ) 

read_point_pen ( &pen[0] ) ; 
i= 0 ; 

15 

/* Waiting for synchro- bit 7 

do 
{ 

if ( ( reply = SerGetChar ( portbase ) ) < 0 ) 

return reply ; 
debug[i++] = reply ; 

if ( ( packagefO] « (char) reply ) & SYNCROBIT ) 
break ; 

} while ( ind_package-M- < 10 ) ; 

25 

r Error - No synchro-bit in 10 bytes 7 

if ( ind_package >= 1 0 ) 
return SER_SYNCROBIT ; 

30 

f* Read the next 6 bytes from tablet and 6 points from accelerometer 7 

for ( tnd__package s= 1 ; ind_package < 7 ; ind package*-* ) 
{ 

35 if ( read_pen ) 

read_point_pen ( &pen[ind_package] ) ; 

} 

if ( ( reply = SerGetChar ( portbase ) ) < 0 ) 
return reply ; 
40 package[ind_package] = (char) reply : 

} 

/* Read last point from accelerometer 7 

^ if ( read.pen ) 

read_point_pen ( &pen[ind_package] ) ; 

/* Calculates the values of the signals for tablet 7 

tablet->x = ( packagefOJ & 0x03 ) « 14 
50 tablet->x += ( package[ 1] & 0x7f ) « 7 ; 

tablet->x += ( package[2] & 0x7f ) ; 

if ( package[0] & 0x04 ) 
tablet->x = - tablet->x : 

tablet->y = ( package[3] & 0x03 ) « 14 ; 
55 tablet->y += ( package[4] & 0x7f ) « 7 ; 

tablet->y ( package[5] & 0x7f ) ; 
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tablet->p = 0 ; 

if ( ! ( package[0; & 0x40 ) ) 

tablet->p = 99 ; 
if ( package[3] & 0x04 ) 

tabiet->y = - tablet->y ; 
if ( package[6] & 0x20 ) 

tablet->p = ( package(6] & 0x1 f ) : 
return 0 ; 



H. Pre-processing 

/* Two procedures: Normalization in time and filtering the input signals by smoothing 

V 

void normal ( int num_old , float arr_oldQ , int num.new , float arr_newQ ) 
{ 

double koeff ; 

int ind_old , ind_new ; 

koeff = (double) { num_old - 1 ) / (float) ( num_new • 1 ) ; 
arr_new[0] = arr_oid[0] ; 

for ( ind_new = 1 ; ind_new < num^new - 1 ; ind_new ++ ) { 
ind_old = (int) ( floor ( koeff * ind_new ) ) ; 

arr_new[ind_new] = ( ind_oid + 1 - koeff * ind_new ) * arr_old[ind_old] -t- 

( koeff * ind_new - ind.old ) * arr_old[ind__old + 1 ] ; 
arr_new[ind_new] = arr_/iew[ind new] ; 

} 

arr_new[ind_new] = arr_old[num_old-1] ; 

} 



float smoothl ( int num f float 2Q ) 
{ 

int ind ; 
float temp ; 
float norma ; 

for (ind = 1 , norma = 0 ; ind < num - 1 ; ind++ ) { 
temp ss ( z[ind -1]+z[ind]+z[ind+1] ) /3. ; 
norma += abbs ( z[ind] - temp ) ; 
z[ind] = temp ; 

} 

return norma ; 



30 
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HI, Parameter's extraction 

/* Calculation of the parameters of a symbol from the input signals V 

5 

int make.par ( char arg_ch ) 
'{ 

struct point { 

unsigned int x : 12 ; 
10 unsigned int y : 1 2 ; 

unsigned int z : 12 ; 

unsigned int pen : 4 ; 
} point , points[500]; 

int read_next_symbol (FILE * , struct pointQ ) ; 
1S char fi!e_name[40J ; 

int len , number_points = 0 ; 

FILE 'injile , *out_Jile[10] , *outJetter , *out_bin ; 

float param[6][NUMBER_POINT] . sum_par[6][NUMBER_POINT] : 

int index = 0 , max_point ; 
2Q int ind , start ; 

int cur_x , cur__y , cur_z , cur_p ; 

float arr_x[MAX_POINT] . arr_y[MAX_POINT] , arr_z[MAX_POINT] , arr_p[MAX_POINT] ; 

r Initialization of the results arrays to zero V 

25 for ( ind = 0 ; ind < 6 ; ind++ ) 

for ( index = 0 ; index < N UMBER_POINT ; index++ ) { 
param[ind][index] = 0.0 ; 
sum_par[ind][index] = 0.0 ; 

} 

30 

r Identification of the file of data 7 



sprintf ( file_name , •%03d.srnb" , (int) arg_ch ) ; 
if ( ( in Jile = fopen ( file_name , "rb" ) ) »= NULL ) 

35 { 

strcpy (ext_err,file_name); 
return -4 ; 

) 

start = 0 ; 

40 

r Reading data from file */ 

while ( ( max_point = read_next_symbol ( in_file , points > ) > 0 ) { 
for ( index = 0 ; index < max_point ; index-M- ) { 
45 arr_xpndex] = (float) points[?ndex].x ; 

arr_y[index] = (float) pointspndexj.y ; 
arr_z[index] = (float) pointspndexj.z ; 
arr_p[index] = (float) points[index].pen ; 

} 

go arr_p[0] = arr_p[max_point - 1] = 1 ; 

start++ ; 

number_points += max_point ; 
/• Calling the procedure make_parjet for calculating parameters 1-6 V 
make_parjet ( arr_x , arr_y . arr_z , arr_p , param , max_point - 1 ) ; 
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/* Calculating the average of each parameter 7 

for ( ind = 0 ; ind < 6 ; ind+- ) 
for ( index » 0 ; index < NUMBER.POINT ; index++ ) { 
sum_par[ind][index] += param[ind][index] ; 

) 

} 

for ( ind = 0 ; ind < 6 ; ind-w- ) 
for ( index = 0 ; index < NUMBER.POINT ; index++ ) 
sum_par[ind][index] /= start : 

sum_par[0][0] = (float) number_points / start ; 
fclose ( in_file ) ; 

/* write avg in Binary file V 

sprintf ( file_name , *%03d.par" , (int) arg_ch ) ; 

outjetter s fopen ( file_name , 'wb+ - ) ; 

for ( index « 0 ; index < 6 ; index-n- ) 

fwrite ( sum_par[index] , sizaofffloat) , NUMBER_POINT , outjetter); 

fciose ( outjetter ) ; 



return start ; 



} 

void make_parjet ( float arrjcQ , float arr_yQ , float arr_zQ , 

^ float arr_p[] , float param[6][NUMBER_POINTl , int max_point ) 

float end_smooth; 



float new_arr_x[500] . new_arr_y[500] . new_arr_z[500] , new_arr_p[500] ; 
Int ind , index ; 

/* Call for pre-processing V 



normal ( max_point , arr_x , NUMBER_POINT , new_arr_x ) 
normal ( max_point , arr_y , NUMBER.. POINT , new^arr.y ) 
normal ( max^pofnt , arr_z , NUMBER_POINT , new_arr_z ) 
normal ( max_point , arr_p , NUMBER_POINT , new_arr_p ) 
max_point = NUMBER_POINT ; 
for ( ind = 0 ; ind < max_point ; ind*H- ) { 

arr_x[ind] « new_arr_x[ind] 

arr_ypndj = new_arr_y[ind] 

arr_z(ind] = new_arr_z[ind] 

arr_p[ind] = new_arr_p[indj 
} 

while ( ( end__smooth - smooth! ( max_point . arr_x ) ) > NUMBER.POINT / 10 ) 
while ( ( end_smooth = smoothl ( max_pdint , arr_y ) ) > NUMBErIpOINT / 10 ) 
while ( ( end„smooth = smoothl ( max_point , arr_z ) ) > NUMBER J*OINT / 10 ) 

r Initialization of parameters 7 
param[0][0] = (float) arr_p[0] ; 
param[1][0] = ( arr_z[0J - arr_z[0] ) ; 
param[2][0] = 0.0 ; 
param[3][0] = 0.0 ; 
param[4][0] =» 0.0 ; 
param[5][0] = 0.0 ; 
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5 param(0][1) = (ftoat) arr_p[l] : 

/" Calculation of parameters V 
param[i][l] = ( arr_z[1] - arr.zfO] ) ; 

elev ( arr_x(2] - arr_x[0] , arr_y[2] - arr_y[0] , arr_z(2] - arr_z(0] , 
&param(2][1] , &param[3][1] ) ; 
10 param[4][1] = 0.0 ; 

param[5][1] = 0.0 ; 

for ( index = 2 ; index < max.point - 2 ; index++ ) { 
param[0][index] = (float) arr^pfindex] ; 
param[l][indexj = ( arr_z(inCex] - arr_z[0] ) ; 

elev ( arr_x[index + 1] - ar:_x[index - 1] , arr_y[index + 1] - arr_y[index - 1J , arr.zfindex + 1] - 
arr_z{index - 1] , 

&param[2][index] , &param[3] [index] ) ; 
angles ( arr_xfindex + 2] - arr_x[index] , 
arr_ypndex + 2] - arr_y[index] , 
arr_z[index + 2] - arr_z[index] , 
2o arr_x[index] - arr_ xfinaex - 2] , 

arr_y [index] - arr_y[index - 2] , 
arr_z[index] - arr_z[index - 2] , 
&param[4][index] , &param[5][index] ) ; 
index = index ; 

} 

25 param(O) [index] = (float) arr_p[Index] ; 

param(1][index] = ( arr_z[index] - arr.zfO] ) ; 

elev ( arr.xpndex + 1] - arr_x[index - 1] , arr_y[index + 1] - arr_y[index - 1] . arr_z(index + 1] - 
arr_z[index - 1] , 

&paramf2]pndex] , &param[3][index] ) ; 
param[4][index] = 0.0 ; 
param[5]pndex] = 0.0 ; 
index++ ; 

r Calculation of parameters for last point */ 
param[0][index] = (float) arr_p[index] ; 
35 param[1][index] = ( arr.zfindexj - arr__z[0] ) ; 

param[2][index] = 0.0 ; 
param[3]pndex] = 0.0 ; 
param[4][index] = 0.0 ; 
param[5][index] = 0.0 ; 

} 

40 

r Procedure elev calculates the SIN and COS of the angle of elevation V 

void elev ( float x . float y , float z , float *cos_ug , float *sin_ug ) 

45 ' „ . 

float norma ; 

norma = (float) sqrt (x*x+y'y+z*z) ; 
if ( norma < .00001 ) { 

*cos_ug = 0.0 ; 

*sin_ug = 0.0 ; 
50 return ; 

) 

*cos_ug = l (float) sqrt ( x * x - y * y ) ) / norma ; 
*sin_ug = z / norma ; 
return ; 

) 

55 
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r Procedure angles calculates the SIN and COS of the angle p V 

void angles ( float x1 , float y1 , float z1 , float x2 , float y2 , float z2 , 
float *cos_ug , float *sin_ug ) 

{ 

float normal ( norma2 , x3 , y3 , z3 ; 
normal ~ ( float ) sqrt ( x1 * x1 y1 * y1 + zl * z1 ) ; 
norma2 = ( float ) sqrt ( x2 * x2 +- y2 * y2 + z2 * z2 ) ; 
if ( normal < .0001 II norma2 < .0001 ) { 

•cos_ug = 0.0 ; 

*sin_ug = 0.0 ; 

return ; 

} 

*cos_ug = ( x1 * x2 * y1 * y2 + z1 * z2 ) / normal / norma2 ; 
x3 = ( y1 * z2 - z1 * y2 ) ; 
y3 = ( x2 * z1 - x1 * z2 ) ; 
z3 = ( x1 * y2 - x2 * y1 ) ; 

*sin_ug = ( (float) sqrt ( x3 * x3 + y3 * y3 + z3 * z3 ) ) / normal / norma2 
return ; 

} 
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IV. Training procedures 

/" Procedure for preliminary teaching V 

int firsMeach ( void ) 
{ 

FILE *tp ; 
FILE -fpout; 
int i; 

char buf[4] , NdxStr[4] , symbols[256] ; 
int ndx = 0 , max_symb = 0 ; 
int num_sym; 

comment ("converting data files, please wait",0,1); 

if ( ( fp=fopen ( "symbols.dat* , "r" ) ) == NULL ) 

{ 

strcpy (ext_err l *symbols.dat ,, ); 

hide_comment ("converting data files, please waif ,0); 
return (-4); 

} 

while ( fscanf ( fp , "%s° , buf ) > 0 ) 

symbols[max_symb4H-] = buf[0] ; 
fclose ( fp ) ; 

fpout=fopen ("textadpyw"); 

for ( ndx = 0 ; ndx < max_symb ; ndx-M- ) { 
sprintf ( NdxStr , "%03d" , ndx ) ; 
if ( { num_sym=make_par ( symbolsfndx] ) ) <= 0 ) 
{ 

hide_ comment ("converting data files, please wait\0); 
return (num_sym); 

} 

else for (i-0;i<num_sym;i++) 

fprlntf (fpout/%c",syrnbols[ndx]); 

] 

fclose (fpout); 

hide_comment ("converting data files, please wait\0); 
return (0); 



r procedure for adaptation of prototypes •/ 

float huge # all_par[100] ; 
int first_adap ( void ) 
{ 

float old_rec , new_rec ; 
int count=0 , temp ; 
char *text ; 
char str[80]; 

if ( ( temp = readjext ("try.txt', &text ) ) < 0 ) 

return ( temp ) ; 
read_param ( ) ; 

new__rec = recogn ( "try.prT , text ,0,6); 
sprintf (str/%3f-before adaptation\new_rec); 
comment (str,-1,1); 
do ( 
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10 



if (new_rec < 0 ) { 
hide_comment (str,-1); 
while ( all_par[temp] != NULL ) { 
farfree ( all_par[temp4-+] ) ; 

} 

return ((int) new_rec); 

} 

if ( new_rec > .995 ) 

break ; 
old_rec = new_rec ; 

new_rec = recogn ( "try.prl", text .1,0); 
if (new_rec <0 ) { 
hide_comment (str,-1); 
15 while ( al!_par[temp] != NULL ) { 

farfree ( all__par[temp-r-*-] ) ; 

} 

return ((int) new_rec); 

} 

20 hide^comment (str,-1); 

sprintf (str,"%3f- in adaptation "\new_rec); 
comment (str,-1,1); 



25 



new_rec = recogn ( *try.prl\ text ,0,0); 

hide_comment (str,-1); 

sprintf (str, "%3f-after adaption a ,new_rec); 

comment (str,-1,1); 

30 if (new_rec < 0 ) { 

hide_ comment (str,-1); 
while ( all_par[temp] != NULL ) { 
farfree ( all_par[temp-M-] ) ; 

} 

35 return ((int) new_rec); 

} 

} while ( fabs ( old_rec - new_rec ) > .005 & countM- < 9 ) 
hide_comment (str,-1); 
40 farfree ( text ) ; ' 

while ( alLpar[temp] != NULL ) { 
farfree ( all_par[temp-H+-] ) ; 

} 

return 0 ; 

45 } 



50 



55 
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V. Symbol's recognition 



struct point { 



unsigned int x 
unsigned int y 
unsigned int z 



12 ; 
12 ; 
12 ; 



10 



15 



20 



25 



30 



35 



40 



45 



50 



unsigned int pen : 4 ; 
} : 

struct reply 
{ 

int ndx; 
float weight; 

}; 

float recogn ( char *file_pen , char Mext , int adapt , int words ) 
{ 

float old_rec , new_rec , probs[10][20] ; 
int count=0 ; 

char symbols[256] , buf[4] ; 
unsigned long ttt ; 
int max_symb; 

FILE *in_file , *file_symb t "temp_word ; 
int symb; 

unsigned long start_word , end_word ; 
float param[6J[NUMBER.POINTl ; 

int index = 0 , max_point ; . 
struct reply *repl ; 
int temp; 
int Ngood=0; 

int ind , NumSymbols t ndx; 

struct point syrnb_pnts [MAX_POINT]; 

float arr_x[MAX_POINTl , arr_y[MAX_POINT| . arr_z[MAX_POINTl , arr_p[MAX_POINT| 
int map(256J; 
int order=0; 

char letters[1 0j[20],dfct_wrds[1 0][20]; 
int end_of_word=0; 
int wrdien; 

float sum(10] I maxsum f ndx_maxsum; 
char org_wrd[20],Lword[20]; 
int txt_width; 
int i; 

if ( ( file_symb = fopen ( " symbols.dat* , V ) ) == NULL ) { 
strcpy (ext_err. "symbols.dat*); 
return (-4); 

} 

for (ind=0;ind<256;ind+4-) map[indj=-1; 
max_syrnb = 0 ; 

while ( fscanf { file__symb , *%s* , but ) > 0 ) 

{ 

map (buf[0]]=max_symb; 
symbol s[max_symb-K+] = buffO] ; 

} 

fclose { file_symb ) ; 
symbols(max_syrnb] = 0 ; 

fcr { ind = 0 ; ind < 6 ; ind++ ) 



37 



EP 0 666 543 A2 



for ( index = 0 : index < NUM3ER_PQINT ; index++ ) { 
param[ind][index] = 0.0 ; 

} 

if ( ( in Jile = fopen ( fiie_pen , -rt>" ) ) — NULL ) 
{ 

strcpy (ext_err,file_pen); 
return -4 ; 

} 

index = 0 ; 
NumSymbols = 0 ; 
symb=-l; 

if (adapt) 

repl = make_corr ( param , symbols , symb) ; 
else ( 

repl - make_corr ( param , symbols , -1) ; 

) 

if (repl[0].ndx<0) 

return ( repl[0] .weight); 

if (repl[0].ndx™symb) 

Ngood++; 
else 

Ngood = Ngood ; 

} 

fclose ( injile ) ; 
if (NumSymbols=0) return 0; 
else return (Ngood/(float)NumSymbols) ; 

} 



/* Calculation of the similarity of all the parameters of all the prototypes and the 
symbol to be recognized */ 

extern float huge *ail_ parfioo] ; 

struct reply 

{ 

int ndx; 
float weight; 

}; 

static int comm_count = 0 , abs_oount = O ; 

int obj_funct ( float [100][7] , int . int , float [1001 . float [7] t int [10] ) ; 

float correl.hem ( float [NUMBEFLPOINTJ . float [NUMBER_POINT] , float ) ; 

float correl ( float [NUMBEFLPOINT] , float [NUMBER_P01N7] ) ; 

struct reply *make_corr ( float curjar[6][NUMBER_POINT] . char 'symbols Jnt symb) 

( 

FILE *cur_file ; 

int ind_repl , ind_corrct , ind , max_symb , ind_symb t index ; 
struct reply an*_repl[30]; 
int arr_ind[10]; 

float res[100] , nres[7] , old_max_pnt = cur_par[0][0] , com_wight ; 
float otd_max_pnt2 , corr[100][7] , tmp_par[6][NUMBER_POINT] ; 
char buf[8] ; 
int iterat; 
struct reply rt: 
int i.j; 
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max_symb = strlen ( symbols ) ; 

for ( ind_symb = 0 ; ind_symb < max_symb ; ind_symb++ ) { 
for ( i = 0 ; i < 6 ; i++ ) 
for ( j = 0 ; j < NUMBER_POINT ; j++ ) 
tmp_par[I][J] = alLpar[ind_symb][noo+j] ; 
if ( tmp_par[0][0] > 0) { 
cur_par[0][0] = old_max_pnt ; 
corr[ind__symb][N_PAR-1] = 1.0 * ( 1 - 

min { fabs ( tmp_par[0][0] - cur_par[0][0] ) / cur_parf0][0] , 1 ) ) ; 

oid_max_pnt = cur_par[0][0] ; 
tmp_par(0][0] = 1 . ; 
cur_par[0][0] = 1. ; 

corrpnd_symb][0] = correLhem ( cur_.par[0] , tmp_par[0] ( .9 ) ; 
for ( ind = 1 ; ind < N_PAR - 1; ind++ ) { 

corr[ind_symb]pnd] = correl ( cur__par[ind] , tmp_parpnd] ) ; 

} 

) 

else 

for ( ind = 1 ; ind < N_PAR - 1; ind++ ) { 
corrpnd_symb]pnd] = 0.0 ; 

} 

} 

if (symb<0) 
{ 

index = obj_funct ( corr , max_symb . N_PAR , res . nres , arrjnd ) .; 
iterat=20; 

} 

else 
{ 

sprlntf ( buf -, "%03xJ.par" , (int) symbolsfsymb] ) ; 
for ( I = 0 ; i < 6 ; i-M- ) 

for ( j - 0 ; j < NUMBER.POINT ; j++ ) 

tmp_parp]0] » all_partsymb]p*100+j] ; 
iterat=0; 

while ( (index=obj_funct (corr.rnax_symb,N_PAR,res t nres, arr_ind))>0 
&& (arr_ind[0]!=symb)) 

{ 

if (iterat>19) break; 

for (ind-0, ind_corrct=0; ind<IM_PAR-1 ; ind-M-) 
if (corr[symb]pnd]<0.95 • nrespnd]) 
{ 

ind_corrct++; 

for (index=0; index < NUMBER^ POINT ; index-M-) 
tmp_par[ind][index] = tmp_par pnd][index]*.9 
+cur_parpnd]pndex]*. 1 ; 

} 

if (corr[symb][ind]<0.95 * nrespnd]) 
{ 

ind„corrct++; 

tmp_par(0][0] = tmp_par[0][0] * .9 + old_max_pnt * .1 ; 

} 

if (iind.corrct) { 
iterat = 20 ; 
break; 

} 
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iterat++; 

cur_par{0][0]= old_max_pnt; 

corr[symb][N_PAR-1]=1-fabs(tmp_par[0][0]-cur_par[0)[0])/ cur_par[0][0]; 
old_max_pnt = cur_par(0][0]; 
old_max_pnt2= tmp_par(0][0]; 
tmp_par[0][0] = 1.; 
cur_par[0][0] = 1.; 

corr(symb][0] = correl_hem ( cur_par{0] , tmp_par[0] , .9 ) ; 
for { ind = 1 ; ind < N_PAR - 1 ; ind++ ) { 

corr[symb][ind] = correl ( cur_par[ind] , tmp_par[ind] ) ; 

} 

cur_par[0][0] = old_max_pnt ; 
tmp_par[0][0] = old_max_pnt2 ; 
} r while 7 
} /• else V 

if ((iterat<20) && (index>0) && (iterat>0)) 
{ 

cur_file = fopen ( buf , n w+b' ) ; 

for ( index = 0 ; index < N_PAR -1 ; index++ ) 

fwrite ( tmp__par[index] , sizeof ( float ) , NUMBER_POINT , cur_file ) ; 
fclose ( cur.file ) ; 
for ( i = 0 ; i < 6 ; i++ ) 

for ( j = 0 ; j < NUMBER_POINT ; j++ ) 
alLpar[symb][i*1 00+j] = tmp_parfl][fl ; 

} 

index = min ( index , 9 ) ; 
arr_ind[index]=-1; 
res[arr_indpndex]]=-1 ; 
for (i=0;i<=index;i++) 
{ 

arr_replp].ndx=arrjnd[i]; 
arr_repl[i].weight=-res[arr_ind[i]]; 

} 

return arr repl ; 

} 



/* Calculation of correlation between two vectors V 

float correl ( float first[NUMBER_POINT] , float second[NUMBER_POINT] ) 
{ 

float sumxy = 0.0 , sumx = 0.0 f sumy = 0.0 , sumx2 = 0.0 , sumy2 = 0.0 ; 
int Ld , f_s ; 

for ( Ls = 0 ; Ls < NUMBER_POINT ; Ls++ ) { 
sumxy += first[i_s] * second[i_s] ; 
sumx ■§-= first[i_s) ; 
sumy += second[i_s] ; 
sumx2 += first[i_s] * firstp_s] ; 
sumy2 += second[i_s] " second(i_s] ; 

} 

if ( ( sumx2 - sumx ' sumx / NUMBER_POINT ) < 0 II 
( sumy2 - sumy * sumy / NUMBER.. POINT ) < 0 ) 
return 0 ; 

if ( ( sumxy = ( sumxy - sumx * sumy / NUMBER_POINT ) / 
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sqrt ( sumx2 - surr.x * sumx-/ NUMBER_POINT ) / 
sqrt ( sumy2 - sumy * sumy / NUMBER^POINT ) ) < .5 ) 
return 0 ; 
return sumxy ; 

} 



/* Similarity function for the parameter of pen up/down 7 

10 

float correljiem ( float par1[NUMBER_POINT] , float par2[NUMBER POINT] , float border ) 
{ 

int index ; 

float result = 0.0 ; 
15 for ( index = 1 ; index < NUMBER_POI NT ; index++ ) 
result += fabs ( pari [index] - par2(index] ) ; 

result /= NUMBER_POINT ; 

result = 1 - result ; 

if ( result < border ) 
20 return 0 ; 

return result ; 

} 



r Selection of the list of symbols that are likely to be the symbol to be recognized V 

25 

int obj_funct ( float arr[100][7] , int n.symb , int n_par , 

float res[100] , float nres[7] , int arrindex[30] ) 

{ 

int ind__s , ind_p , ind_arr = 0 ; 
30 float max__res = 0.0 , curares . abs_res = 0.0 ; 
int result = -1 ; 

for ( ind_s = 0 ; ind_s < n_symb ; ind_s+-h ) { 
for ( ind_p = 0 . cur_res = 0.0 ; ind_p < n_par ; ind_p++ ) 
curares += arr[ind_s]pnd__p] ; 
3 5 res[ind_s] = cur_res ; 

if ( cur_res > max_res ) { 
result = ind_s ; 
max res = curares ; 

} 

40 ^ 

abs_res = max_res * .85 ; 
do { 

arrindexpnd_arr++] = result ; 
resfresult] = - resfresult] ; 
^ for ( ind_s = 0 , max_res = 0.0 ; ind_s < n_symb ; ind_s++ ) 

if ( res[ind_s] > rnax_res ) { 
result = ind_s ; 
max_res = res[ind_s] ; 

} 

} while ( max.res > abs.res && ind_arr < 30 ) ; 
50 for ( ind_p = 0 ; ind_p < n__par ; ind_p++ ) 

for ( ind_s = 0 , nres[ind_p] = -5 ; ind_s < n_symb ; tnd_s++ ) 
nres[ind_p] = max ( arr[ind_s]find - p] , nres[ind_p] ) ; 
return ind_arr ; 

} 
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APPENDIX B 
Recognition according sec nd method 

Braphic Tablet recognition 

. initialization of work 

•oid main(void) 

void init_map(void); 
int ij; 

for Ci=0;i<NUM_SYMBOLS;K+) 
for (j=0;j<2J++) 

map_charplID=0; 
init_map0; 



extern int map_char[NUM_SYMBOLS][2]; 

oid save_map(void) 

FILE *fp; 
int i; 

fp*f open ("map_ch" ."wb") ; 

for (i-0; i<NUM_SYMBOLS;i++) 

fprintf(fp,"%d %d\n",map_char[i][0] f map - char[a[1]); 
fclose(fp); 

oid init_map(void) 
int ij; 

for 0 a= 97 f j=Q;i<123u+-»'J++) 
{ map_charlfl[0]=i; //a-z 
map_char[fl[1]=0; 

} 

for (i=65j=26;i<91;j++ l i++) 
{ map_char[fl[0)=i; //A-Z 
map_char[fl[1]=0; 

} 

for (i=48j=52;i<58j++j++) 
{ map_char[j][0]=i; 
map_char[j](1]=0; //0123456789 

} 

for (i=43,j=62:i<47;rn-,i+-»-) 
f map char[nf01=i; 
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pr = 0; 
break; 

} 

5 } 
} 

} 

for (count=0; cbunt<numjig; count++) 
{ temp = ARRJJG1[count].x_end; 
10 ARRJUG1 [count].x_end = ARR_UG1 [count] .x_beg; 

ARRJJG1 [count] .xj>eg = temp; 

temp = ARRJJG1[count].y_end; 

ARRJJG1 [count] .y_end = ARRJJG1 [count] .yjjeg; 

ARRJJ Gl [count] .yj>eg = temp; 

To 

temp = ARRJJG1[countJ.pns_end; 
ARRJJG1[count].pns_end = ARRJJG1[courrt].pns_beg; 
ARR_UG1 [count]. pns_beg = temp; 

} 

20 return(num lig); 

} 



function ord_1 Jig1 0 defines one order right up strokes from the 
25 begining of right up strokes in the arr_extremomsD .records one 

order right up stroke's parameters to ARR_ORDJ JJG1Q according 
to his number and labels MASK penn. 

int ordj Jig1(int num_of_extrms,int numjigl) 
30 { int pr,numJig,numj3ns,count,num_str; 
unsigned temp; 

pr = 0; 

num_pns = 0; 
35 numjig = 0; 

if (num_lig1 == 0) 
return(O); 

for (count = 0; count < num_Dg1; count++) 
{ 

pr = 0; 

if (ARRJJG1[count].pnsJ>eg < (unsigned)2) continue; 
if (penn[ARR_UG1[count].pns__beg].form_code«0) continue; 
if (arr_extremoms[ARR_LIG1[count].pns_beg-1l.dir > 2 ) continue; 
if (penn[ARR_UG1[count].pns_beg-1].form_code!s=0) continue; 
if (arr_extremoms[ARR_LIG1[count].pns_beg-1].pen_sts (unsigned) 0) 

continue; 
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for (num_str = ARRJJG1 [count]. pns_beg-l; num_str >= 1; 

nunrvstr- ) 

{ if ((arr_extremoms[num_str].dir <= 2 ) 
50 &&(arr_extremoms[num_str].dir >= 0 ) 

&& (penn[num_str] .f orrn_code==0)) 

{ if (pn=0) 

{ ARR_ORD_1 JJG1[numJig].num = num_lig; 
ARR„ORDJJJG1[numJig].pnsJ>eg «= num_str; 
55 ARR_ORD_1_LIG1 [numjig] jc_beg = aiT_extremoms[num_str+1].x_cor; 

ARR_ORD_1_L1G1 [numjig] .yj>eg = an_extremoms[num_str+1].y__cor; 
ARR_ORDJ_LIG1[numJig].pns_end = num_str; 
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II- Training procedures 

r MAIN FOR TEACHING V 

struct TABLE.EXTREMOMS aiT_exttemoms[MAX_NUM OF_EXTREMOMS]; 

struct POINT arr_corIMAX_NUM_OF_POINTS]; 

struct LIN ARR_DI R[MAX_AM O U NT DIRECJ; 

struct LIG ARRJJGAT[MAX_AMOUNT_DIREC]; 

Struct LIG ARR_0 RD_1 _LI G AT[M AX_AM OUNT_DI RECJ ; 

struct LIG ARRJJG1[MAX_AMOUNT_DIREC]; 

struct LIG ARR_ORDJJJG1 [MAX_AMOUNT_DIREC]; 

struct LIG ARR_UG2|MAX_AMOUNT_DlREC]; 

struct LIG ARR_ORDjl_UG2[MAX_AMOUNT_DIREC]; 

struct LIG ARR_U G3[MAX_AMOUNT_DI REC]; 

struct LIG ARRJDRD_1JJG3[MAX_AMOUNT_DIREC]; 

struct MASK penn[MAX_NUM_OF_EXTREMOMSJ; 

char our.sentIMAX_LENGTH_SENTENSEl; 

struct X x[MAX_AMOUNT_DIRECJ; 

struct Y y[MAX_AMOUNT_DIRECl; 

int map_chaitNUM_SYMBOLS][Zl; 

int amp_y; 

int num_of_extrms; 

float y_vec_beg; 

float y_vec_end; 

float x_vec_beg; 

float x_vec_end; 

void main(int arg,char *parfl) 
{ * 

FILE *fp; 

char infile[30]; 

int num; 

struct ffblk ffblk; 

int done; 

read_mapO; 

fp=fopenCfextr.ou^\rtT); 
fclose(fp); 

fp=fopenrfeat.outVwb*); 
fclose(fp); 

fp^fopenffeatl .outYwb"); 
fclose(fp); 

fpsfopenffeentO.outVwb"); 
fclose(fp); 

fp=fopenffsent1 .our.^b"); 
fclose(fp); 

fp^fopenrfsent2.out^b w ); 
fclose(fp); 

fp=fopen( w fsent3.out\"wb-) ; 
fclose(fp); 

fp*fopen( H fsent4.0Llt^ t, wb ,, ) ; 
fclose(fp); 

fp=fopenrfsent5.out",* % wb"); 
fclose(fp); 

fp=fopenCfsent6.our ( w wb*); 
fclose(fp); 

don =findfirstp.tab-,&rfblk,0); 
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num=1; 
while (!done) 
{ 

sprintf Onfile.'%-1 2. 1 2s",ffblk.ff_na me) ; 
fp=fopen(infile ,"r") ; 
if (!fp) 

{ printffCant open input file -%s— Vn-.infile); 
return; 

} 

if (infile[OJ !=*B') letter=tolower(infjle[OJ); 
else 

{ if (isdigit( (int) infile[1] ) !=0) letten=tolower(infile[0]); 
else letter=infile[1]; 

} 

num^transformCfp.&letter); 

if ((num>=0)&&(num<7)) save_files(num f &letter); 

if (num=-3) num=t; 

fclose(fp); 

done=findnext(&ffblk); 

} 

save_mapQ; 



int transform(FILE *fp,char 'letter) 
{ 

extern struct POINT arr_cor[MAX_NUM_OF_POINTS]; r array of coordinates */ 
extern struct TABLE_EXTREMOMS arr_extrernomstMAX_NUM_OF_EXTREMOMS]; 
r array of special points 0.e. extremums , changing of pen 

position '/ 

extern struct TABLE_EXTREMOMS arr_exc_extrnis[MAX_NUM_OF_EXTREMOMS]; 
r array of excluded extremums , it is excluded from the array 
of extremums by excluding close points */ 
extern struct LIN ARR_DlR[MAX_AMOUNT_DIREC]; 
extern struct LIN ARR — Dl R[M AX_AMO UNT_ Dl RE C] ; 
extern struct LIG ARR_LI G AT[M AX_AM O UNT_DI REC] ; 
extern struct LIG ARRJ3RDJ _LI G AT(MAX_AM OUNT_DI RE CJ ; 
extern struct LIG ARR_LIG1[MAX_AMOUNT_DIREC]; 
extern struct LIG ARR_ORD_1 JJG1 [MAX_AMOUNT_D!REC]; 
extern struct LIG ARR_LIG2[MAX_AMOUNT_DIREC]; 
extern struct LIG ARR_ORD_1_LIG2[MAX_AMOUIMT_DIRECJ; 
extern struct LIG ARRJJG3[MAX_AMOUNT_DIRECJ; 
extern struct LIG ARR_ORD_1_LIG3[MAX_AMOUNT_DIREC]; 
extern struct MASK pennlMAXJSIUM_OF_EXTREMOMS]; 
extern char our_sent[MAX_LENGTH_SENTENSE]; 
extern struct X x[MAX_AMOUNT_DIRECJ; 
extern struct Y y[MAX_AMOUNT_DIREC]; 
extern int amp_y; 
extern int num_of_extrms; 

int count; 

int num; 

int num_direc; 

float length_ofJetter; 

int num_Iigat_d_r_o; 
int num_ord_1Jigat; 
int num_ligat_u_M; 
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int num_ortiMJigl; 
int numJigat_d_l_o; 
int num_ord_1_lig3; 
int numjigat_uj_i; 
int num_ord_1_lig2; 
int index_max_dir; 
int amp_x; 

num=read_symb (fp, letter); 
if ((num==-2)||(num==1)) return(-1); 
ff (num==0) return (-1); 
if (num=— 3) return (-3); 
if (num > MAXJSIUM_OF_POINTS-1) 
{ priritf ("Input file too huge\n"); 
getchO; 
retum(-1); 



num_of_e)rtmTs=calc_e3rtremoms (num); 
if (num_of_extrms > MAX_NUM_OF_EXTREMOMS-1) 
{ printfCArray of extremums too hugeVn"); 

getchO; 

return(-1); 

} 

length_oMetter»letteMength(num,air_cor); 

filtr(num_of_extrms); 

am P_y =ar npLy(num,arr_cor); 

amp_x«ampl_x(num,arr__cor); 

start(num M .of_extrms); 

if ((num_direc=direct(num_of_extrms))==0) 
{ printfpt's no directions\n"); 
getchO; 
return(O); 

} 

index_max_dir=length_angl(num_direc,ARR_DIR); 



if (filtr_1 (length_ot_letter ( num_direc,num_of__extrms)==1) 
{ start(num_of_extrms); 

if ((num_direc=direct(num_of_extrms))=«0) 
{ printf fit's no directions after conversion and filtr_1\n*); 
getchO; 
return (0); 

} 

index max_dir=length_angl(num_direc,ARR_DIR); 

} 

if (filtr_2(length_ofJetter,num_direc)«1) 
{ start(num_of_extrrns); 

if ((num_direc=direct(num_of_extrms))==0) 
{printf ("It's no directions after conversion filtr_1 and _2\n"); 
getchO; 
return (0); 

} 

index_max_dir=length_angl(num_dir c,ARR_DIR); 

} 



} 




fifter for long down 
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if (fiftr_3(length_ofJetter.nurn_direc,num_of_extrms)==1) 
{ start(num_of_ xtrms); 

if ((niim_direc==direct(num_of_extrms))==0) 
{printtflfs no directions atter conversion fittr_1 ,_2 and _3\n"); 

getchO; 
retum(O); 

} 

index_max_dir»length_angl(num_direc,ARR_DIR); 

} 

numJga^d^r^oatigaKnum^of^extrrns.nurn^direc); 

num_ligat_u_M=lig1 (num_of_extrms,num_direc); 

num_ligst_u J Js|ig2(num_of_extnrns ,num_direc) ; 

num^Iigat^dJ^ostigSCnum^of^extrrns.num^direc); 

num_ord_1 _Bgat=ord_1 _ligat(num_of_extrms, num__0g at_d_r_o) ; 

num_oTd__1_Bg1»ord_1_Gg1 (num_of_extmis,numJgat_u_rJ); 

num_ord_1_6g2=ord_1_0g2(num_of_extrms,num_Dgat_uJJ); 

num_ord_1 _fig3=ord_1 _Ug3(num_of_extrms, n um_figat_d_Lo) ; 

curve(num_of_extrms); 

if (sentense(num_of_extrms)==0) 

printfOt's no sentense\n"); 
conv_diMrain(num_direc t amp - y l ARR_DIR,x,y); 

return (num_direc); 

} 

r This module is for calculating and manipulating extremums , it includes 
three procedures : 

(1) calc extremums : To find the extremums of the symbol . and the 

"change in pen** points. 

(2) find_max_extrm : To find the max/min X-coordinate and the 

max/min Y-coortiinate of the symbol. 

(3) analyse_extremums : A procedure to analyse the extremums found so 

far , mainly this procedure marks close extre 
-mums as suspecious extremums. 



/ 

The input of this procedure is the array of coordinates which holds the 
coordinates of the symbol % and the number of these points , it fills 
the special of points (i.e. , extremums or change in pen) in the array 
arr_extremums , it returns the number of special points it found. 

/ 

struct TABLE_EXTREMOMS extrm[MAX_NUM_OF_EXTREMOMS]; 
extern struct POINT arr_cor[MAXjsiUM_OF_POINTSl; r array of coordinates */ 
extern struct TABLE_EXTREMOMS arr_extremoms[MAX_NUM_OF_EXTREMOMS] ; 
r array of special points (i.e. extremums , changing of pen 

position */ 

extern struct TABLE_EXTREMOMS arr_exc_extrms[MAX_NUM_OF_EXTREMOMS]; 
r array of excluded extremums , it is excluded from the array 
of extremums by excluding close points */ 
struct TABLE.EXTREMOMS arr_exc_extrm[MAX_NUM_OF_EXTREMOMS]; 



int calc_extremoms (int num_of_points) 
{ 

int def_quart (int x,int y); 
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unsigned int indE; 
unsigned int ndx; 
unsign d pen_was_up; 
int crnt_quart,prev_quart; 
int crnt_rot,prev_rot; 
int Sx ( Sy,PSx f PSy,a,b; 
int first_ point=1; 
int Pndx=0; 
unsigned int Last Ndx; 
int i; 

indE«0; 
ndx=0; 

pen_was_up=1 ; 

Sx=0; 

Sy=0; 

PSx«0; 

PSy=0; 

a =0;b=0; 

while (ndx<num__ofjx>ints) 
{ 

while ((an_cor[ndx].pen status)==1) 
{ 

if (pen_was_u p== 1 ) 
{ r beginning extremom V 
if (first_point==1) 

{ 

inttSx.tSy; 

Sx=(arr_cor[ndx+1].x_cor-an_cortndx].x_cor); 

Sy=(arr_cor[ndx+1].y_cor-arr_corlndxJ.y_cor); 

tSx=(an^_cor[ndx+2j.x_cor-an_cor[ndx+1].x_cor); 

tSy=(arr_cor[ndx+2l .y_cor-an_cor(ndx+1] .y_cor); 

a=Sx*tSy-Sy*tSx; 

b=SxMSx+Sy*tSy; 

PSx=Sx; 
PSy=Sy; 

} 

else { 

T for the previous ENDING extremom V 

Sxs=(an_cor[ndx].x_cor-an_cor[Pndx]jc_cor); 

Sy-(arr_cor[ndx].y_cor~arr_cor[Pndx].y_cor); 

PSx=(arr_cor[Pndx].x_cor-arr_cor(Pndx-1].x_cor); 

PSy=(arr_cor[Pndx].y_cor-arr_cor[Pndx-1].y_cor); 

a=PSx*Sy-PSy*Sx; 

b=PSx*Sx+PSy*Sy; 

arr_extremoms[indE].p_ndx=Pndx; 

arr_extremoms[indE]jc_cor=arr_cor[Pndx].x_cor; 

arr^extremomsIindEi.y^copsan^cortPndxj.y^cor, 

air_extremoms[indE].pen_sts=0 ; 

arr_extremorre[indE].dir s def_quart(PSx,PSy); 

arr_extremomspndE].oiit_rot=def_quart(b,a); 

{ 

int PPSx.PPSy; 

P PSx=(arr_cor[Pndx-1 ] .x_cor-arr_cor[Pndx-2] .x_cor) ; 
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PPSy=(arr_cor[Pndx-1].y_cor-arr_cor[Pndx-2].y_cor); 
a=PPSx*PSy-PPSy*PSx; 
b=PPSx w PSx+PPSy*PSy; 
arr_extremomspndE]an_rot=def_quart(b I a); 

} 

indE++; 
PSx=Sx; 
PSy=Sy; 
{ 

int tSx.tSy; 

Sx=(arr_cor[ndx+ 1 ] .x_cor-arr — cor[ndx] .x_cor); 
Sy=(arr_cor[ndx+ 1 "] .y_cor-anr_cor}ndx] /y_cor); 
tSx=(arr_cor[ndx] .x_cor-arr_cor[Pndx] JC_cor); 
tSy-(arr_cor[ndx] .y_cor-arr_cor[Pndx] .y_cor); 
a=tSx*Sy-tSy*Sx; 
b=stSx*Sx+tSy*Sy; 

} 

} 

crnt_quart==def_quart(Sx f Sy); 
crnt_rot=def_quart(b,a); 

aiT_extremornspndE].p_ndx=ndx; 
ai7_extrernoms[indE].x_cop=arr_cor[ndx].x_cor; 
arr_extremomsnndE].y_con=arr_cortndx].y — cor; 
arr_extremoms[indE].pen_sts=1 ; 

if (firstj)oint==1) { 

aiT_extremoms[indE].dip=1 5; 
arr_extremoms[indE].irwot=1 5; 
arr_extremoms[indE].out_rot=15; 

ndx++; 

first_point=0; 

} 

else { 

air_extremoms[indE].dir=def_quart(PSx,PSy); 

arr_extremoms[indE].in_rot=0; 

arr_extremomstindE].out_rot=def_quart(b t a); 

} 

indE-n-; 

pen_was_up=0; 
} else { 

crnt_quart=def_quart(Sx f Sy) ; 

cmt_rot-def_quart(b,a); 

if ((txO) && ((a/b)<-10)) cmt_rot=2; 

if ((txO) && ((a/b)>lO)) crnt_rot=6; 

if (( <crnt_quart!=prev_quart) )) r\\ 

((crnt_rot>=4) && (prev_rot<4)) || 
((crnt_rot<4) && (prev_rot>=*4)) 

) 

&& (prev_rot!=15)) 7 
{ r regular extremom 7 

if <(abs(Sx)>0) || (abs(Sy)>0) || (b<0» 
{ 

if ((ndx-1 -arr_extremoms[indE-1].p_ndx)>0) 
{ 
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arr_ xtremomspndE].p_ndx=ndx-1 ; 
arr_extremomsnndE]Jc_cop=arr_corIndx-1].x 
arr_extremoms[indE].y„cor=arr_corIndx-1].y. 
ai7_extremomspndE].pen_sts=1 ; 
an_extremoms[indE] ,dir=prev_quart; 
arr_extremoms[indE] .in_rot»prev_rot; 
a rr_extremomsflndE} .out_rot=crnt_rot; 
indE++; 

} 

} 

} 

} 

ndx-M-; 

Sx=(arr_cor[ndx] .x_cor-arr_cor[ndx-1].x_cor) ; 

Sy=(arr_cor[ndx] .y_cor-aiT_cor[ndx-1 ] .y_cor) ; 

a=PSx~Sy-PSy*Sx; 

b=PSx*Sx+PSy*Sy; 

PSx=Sx; 

PSy^Sy; 

prev_q uart=cmt_q uart; 
prev_rot=crnt_rot; 
} r end of while (arr_cor[ndx].penstatus==1) V 

if ((pen_was_up=«0) && (aiT_cor[ndx-1].pen_status=-1)) 
{ r ending extremorn V 
Pndx«=ndx-1; 
pen_was_up=t ; 
LastNdx=ndx-1 ; 

} 

ndx++; 
} r ndx<=NumOfPoints V 

r Add the last special point to the array */ 
arr_extremomspndE] .p_ndx=LastNdx; 
arr_extremomspndE] .x_cor=arr_cor[LastNdx] .x_cor; 
arr_extremoms[indE]«y__cor=an_cor[LastNdxj.y_cor; 
air_extremoms[indE] .pen_sts-0; 

Sx= (arr_cor[LastNdx-1 ] .x_cor-a rr_cor[LastNdx-2] .x_cor) ; 

Sy=(arT_cor[LastNdx-1].x_cor-an - cor[LastNdx-2].x_cor); 

PSx=(arr_cor[LastNdx-2].x_cor-arr_corILastNdx-3].x_cor); 

PSy=(an*_cor[LastNdx-2].y_cor*arr_corILastNdx-3I.y_cor); 

air_extremomspndE] .diP=def_quart(Sx,Sy) ; 

a=PSx*Sy-PSy*Sx; 

b=PSx~Sx+PSy*Sy; 

air_extremorris{indE].in_ rot=def__quart(b ( a); 
arr_extremoms[indE].out_rot=1 5; 
return (indE): 
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This procedure is to find the max/min X-coordinate and the max/min 
Y-coordinate of the symbol. 

5 ~ - / 

void find_max_extrm (int num_of_extrms. 

irrt ~Xmin,int ~Xmax,int *Ymin,int *Ymax) 

{ 

unsigned int i=0; 
10 *Xmin=1200; 

*Xmax=0; 

*Ymin=1200; 

*Ymax=0; 

15 while (i<=num_pf_extrms) 

{ 

if (arr_extremomsti].x_cor<*Xmin) *Xmin=an_extremomsp]jc_cor; 
if (arr_extremoms[Q.x_cor>*Xmaxj *Xmax=an_extremoms[i].x_cor; 
if (aiT_extremoms[q.y_cor<*Ymin) •Yrnin=aiT_extrernoms[i].y_cor; 
20 if (air_extremoms[iJ.y_cor>*Ymax) *Ymax=arr_extremoms[I].y_cor; 

> 

} 
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correct dir,in_rot,out_rot for suspicious points , called from 
analyse_extremums 

void correct_extrm (int i f int Pi jnt j) 
{ 

int def_quart (int x.int y); 
int Sx.Sy.PSx.PSy; 
int ndxl ,ndx2; 
int a,b; 



ndxl =extrm[Pi].p_ndx; 
ndx2=extrm[i].p_ndx; 
if (Pi>0) 
{ 

if (extrm[Pi-1].pen_sts==0) 
{ 

P Sx=arr_cor|ndx 1 ] .x_cor-arr_cor[extrm[PM ] . p_ndx] .x_cor; 
P Sy rr_cor|ndx 1 J .y_cor-an_corlextrm[Pi-1 ] . p_ndx] -y_cor; 

} 

else { 

PSx=arr_cor[ndx1 ] .x_cor-arr_cor[ndx1 -1 ] .x_cor; 
PSy=arr_cor[ndx1 j .y_cor-arr_cor[ndx1 -1].y con 
> 

} else {PSx=0;PSy=0;} 
Sx=arr_cor[ndx2] .x_cor-arr_cor[ndx1] .x_cor; 
so Sy-arr_cor[ndx2].y_cor-arr_corlndx1].y„cor; 
a=PSx*Sy-PSy*Sx; 
b= P Sx*Sx+ PSy'Sy ; 
if (arr_exc_extrm[j-1].oirt_rot!=15) 

arr_ xc_extrm[j-1].out_rot=def_quart(b t a); 



PSx=Sx; 
PSy=Sy; 
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arr_exc_extrm[D.dir=def.quart(PSx t PSy); 

arr__ xc_extrm[j].in_ro1=0; 

if (air_exc_extiTn[fl.out_rot!=15) 

{ 

If (extrmp].pen_sts==0) 
{ 

Sx=arr_cor[extrm[i+ 1 ] .p_ndx].x_cor-arr_cor{ndx2] .x_cor; 
Sy=arr_cor[extrm[i+1].p_ndx}.y_cor-an_cor[ndx2].y_cor; 

} 

else 
{ 

Sx=arr_cor[ndx2+ 1 ] .x_cor-arr_cor[ndx2].x_cor; 
Sy»arr_cor[ndx2+1].y_cor-aiT_cor[ndx2].y cor; 

} 

a=PSx w Sy-PSy*Sx; 
b=PSx*Sx+PSy*Sy; 

a rr_exc_extrm[fl .out__rot«def_qua rt(b , a) ; 

} 

} 

; * * 

A procedure to analyse the extremums found so far , mainly this procedure 
marks clo se extremums as suspecious extremums. 
~~ ' / 

int anatyse_extremoms (int num_of_extims) 

{ 

int i j=0; 
int count=0; 
int Pi=0; 

boolean FirstP=TRUE; 

for (i=1;i<num_of_extrms;i++) 
{ 

if (( (abs(extrm[Q.x_cor-extrmp+1].x_cor))<2 || 
(abs(extrm[il.y_cor-extrm[i+ij.y_co0)<2) && 
(extrm[i].in_rotl=extrm[i+lJ.in__rot) && 
(extrm[i].dip==extrmp+1].dir) && 
(extrm[i].pen_sts==1) && 
(extrm[M].pen_stsM=0)) extrm[i].susp=1; 

else {extim[iJ.susp=0;oount++;} 

} 

extrm[0].susp=0; 
extrmp].susp=0; 
count++; 

for fi=0;i<enum of_extrms;i++) 
{ 

if (extrm[i].susp»=0) { 

arr_ex c_extrm[jl .p_ndx*extrmtfl . p_ndx ; 
arr_exc_extrm[0.x_cor=extrmp|.x_cor; 
arr_exc_extrm[j] .y_cor=extrm[i] .y_cor; 
arr_exc_extrm[D.pBn_sts=extrm[i].pen„sts; 

arr_exc_extrmlfl.dip=extrm[ij.dir; 

arr_exc_extrm[fl.in_rot =extrmP].in_rot; 
arr_exc_extmi|II.out_rot=extrm[i].out_rot: 

if (FirstP" FALSE) 
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{ 

correct_extrm (i.Pij); 
FirstP=TRUE; 

} 

if (extrmp).pen_sts— 0) FirstP=TRUE; 

} 

else { 

if (FirstP) PN-1; 
FirstP=FALSE; 

} 

} 

for (i=1;i<=count;i++) 

if (extrm[i-1].p_ndx==(extrmp].p_ndx-1» arr_exc_extrmp] .in_rot=0; 
return (count); 



r mmm t 

function iength_anglQ calculates length for the each long down and 
returns the number of the long down with the max lengt. 

" ' • / 

int length_angl(int numjin,struct LIN ZQ) 

{ int count,dx,dy,max_dy,maxJengthJ_maxJengthj_max_dy; 

float tng; 

max_dy=0; 

max_jength=0; 

for (count=0;count<numjin;count++) 
{ dx=Z[count].x_end-Zlcount].x_beg; 
dy=Z[countj .y_end-Z[count] .y_beg; 
Zlcount]. length = (unsigned)sqrt((float)dx*(float)dx+ 

(float)dy*(float)dy); 

if (max_dy < abs(dy)) 
{ max_dy = abs(dy); 
i_max_dy = count; 

} 

if (maxjength < Z[count]. length) 
{ maxjength = Z[count]. length; 
i_rnaxjength = count; 

} 

if ((dx==0)&&(dy>0)) tng=M_Pl/2;r 90 V 
else 

if ((dx™0)&&(dy<0)) tng=-M_PI/2;r -90 */ 
else 

if ((dx==0)&&(dy==0)) tng=999999; 
else 

tng«atan((fioat)dy/(float)dx); 
if (tng < 0) tng«tng+M_PI; r angle + 180 */ 
Z[count) .angle = tng; 

> 

retu rn (i_max_dy); 

} 
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function ampl__y() calculates maximum and minimum of y coordinate 
and returns y - amplitude. 

int ampi_y(int num_of _points f struct POINT arr_corQ) 
{ int min.maXtCounttemp; 

min=aiT_cortO].y_cor; 

max=arr_cor[0] .y_cor; 

for(count= 1 ;count<=num_ofjpoints ;count++) 
{ if (arr_cor[count].pen_status==0) continue; 
if (max < an_cor[count].y_cor) 

max=arr_cor[count].y_cor; 
if (min > arr_cor[count].y_cor) 

mi n=arr_corf count] .y_cor; 

if (max==min) max=max+1 ; 

y_vec_beg=(ftoat)(arr_cor[0].y - cor-min)/(float)(max-mln); 
y_vec_end=(float)(arr - corlnum - of_points-1 ] .y_cor-min)/(float)(max-min); 
retum(abs(max-min)); 

} 

int ampLxQnt num__of_points,struct POINT arr_corQ) 
{ int min f max,count,temp; 

min=arr_cortO].x_cor; 

max=arr_cor[0] ,x_cor; 

for(count=1;count<=num_of_points;count++) 
{ *f (aiT_cor[count}.pen_status==0) continue; 
if (max < arr_corfcount].x_cor) 

max=a rr_cor[count] .x_cor; 
if (min > arr_cor[count].x_cor) 

min=arr_cor[count].x_cor; 

if (max==min) max=max+1; 

x_vec_beg=(float)(arr_cor[0].x_coNmin)/(float)(max^min); 

x_vec_end=(float)(arr_coitnum_ofj» 

return(abs(max-min)); 

} 



function conv_dir_train() calculates relative ordinates of letter 
skeleton. 

" milli — — — , 

void conv__dirjrain(int num_dir,int ampjy.struct LIN ZQ.struct X xQ, 

struct Y yfl) 

int count; 
int x_min=9999; 
int y_min=9999; 
int x_max=0; 
int y_max=0; 

for (count*0; count<num_dir; count++) 

{ if (Z[count].x_beg < x_min) x_min=Z[count].x_beg; 
if (Z[count].x_beg > x_max) x_max«Z[count].x_beg; 
if (Z[count].x_ nd < x_min) x_min-Z[count].x_end; 
if (Z|count].x_end > x_max) x_max=Z[count].x_end; 
if (Z[count].y_beg < y_min) y_min=Z[count].y_beg; 
if (Z[count].y_beg > y_max) y_max=Z[count].y_beg; 
if (Z[count].y_end < y_min) y_min=Z[count].y_ nd; 
if (Z[count].y_end > y_max) y,_max=Z[count].y_end; 
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} 

for (count=0; count<num_dir; count++) 
{ x[count].x_b*(float)(Z[count].x_beg-x_min)/(float)(y.max-y_min); 
y[count].y_b=(float)(2[count].y_beg-y_min)/(float)amp_y; 
xlcount].x_e=(float)(Zlcount].x_end-x_min)/(float)(y_max-y_min); 
y[count].y_e=(float)(2[count].y_end-y_min)/(float)amR_y; 

return; 
} 

float letter Jength(int num__of _points,struct POINT arr corQ) 
{ int i; 
double res =0.0; 

for (i=0;t<num_of_pointe;i-w.) 
{ if (arr_cor(i].pen_status!=0) 

res=res+hypot((double)((signed)arr_^ 

(double)((signed)air_corp+1J.y_cor-(signed)arr_corIf].y_cor)); 

retum((float)res); 

} 



function filtrO calculates one's more stroke's directions and corrects ft 

in the array arr_extremoms. 

*7 

void fittr(int num_of_extrm) 
{ int count.dir; 
int def_quart (int x.int y); 

for (count = 0; count <= num_of_extrm; count++) 
{ dir=def_quart (arr_extremomslcount+1].x_cor-arr_extremoms[count] .x_cor, 
arr_extremoms[count+ 1] .y_cor-arr_extremoms[count] y_cor) ; 
if (dir!«an_extremoms[count+1].dir) 

an_extremoms[count+1].dir=dir; 

} 

r* 

function filtrj returns 0,if there wasnt filtration. 

corrects the array arr^extremomsQ and returns 1,if there was filtration. 

filtrj takes away a long down.lf she is first or last.if there are no 

penstrokes before (for the first) or after ( for the last long down) and 

if relative length of deleted long down is less 0 2 

*V 

* nt , fif^ < flo f * /, en ff- 0 ^ ener '' nt nurn_dir t int num_of_extrm) 

return 0 there wast filtration 
1 was filtration 

{ int temp=0; 
int count; 

if (((fioat)ARR_DIR[0].length/length_of_letter < TRESH_F1)&& 
(ARR_D!R[0].pns_beg==1)) 
{ for (count=0;count<=ARR_DIR[0].pns_end;count++) 
arr_extremorns[count] .pen_sts=0; 
temp=1; 

} 
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if (((float)ARR_D1R[num_dir-1].length/length_of_letter < TRESHJ=1)&& 
(ARR_D! R[n um_dir-1 ] .pns_end==num_of_extrrn)) 
{ for (count=ARR_DIR[num_dir-1].pnsj3eg-1; 

courrt<=ARR_DIR[num_diM].pns_end;count'H>-) 
arr_extremoms[count] . pen_sts=0; 
ternp=1; 

} 

return(temp); 

> 

r* 

function fiftr_2 returns 0 if there wasnt filtration. 

corrects anay an_extremomsQ, returns 1, if there was filtration. 

fittr_2 takes away a one penstroke betweem two long down.if 

distance x between long down <= 5 and distance y between long down <= 2. 

**/ 

int fifo_2(float length_of_letter,int num_dir) 
{ int temp=0,i; 
for (i=0;i<num_dir-2;i++) 
{ if (ARR_DIRp+1].pns_beg-ARR_DIRpl.pns_end > 2) continue; 
if (abs(arr_«ctremoms[ARR_DIR[i+1].pns_beg].dir - 

arr_extremoms[ARR_DIRpi-pns__endl.dlr) > 1) continue; 
if (hypot((double)((signed)aiT_extreRK3ms[ARR_DIRn+1].pns_beg].x_cor - 
(sig ned)arr_extremoms[ARR_DI R[0 . pns_end] .x_cor) , 
(double)((signed)arr_extremoms[ARR - _DIRp+1] i pns_beg].y_cor - 
(sig ned)arr_extremoms[ARR_DI R[i] .pns_end] .y_cor)) 

/(double)length_ofjetter < (double)TRESH_F2) 
arr_extremoms[ARR_DIRp].pns_end+1].dir= 

arr_extremoms[ARR_Dl R[Q .pns_end] .dir; 

temp=1; 

> 

return(temp); 

} 

r* 

function filtr_3 returns O.if there wasnt filtration. 

corrects array arT_extremomsQ, returns , if there was filtration. 

takes away long down before stroke with pen up»0, if long down's 

length 0.2 from max length. 

*V 

int filtr_3(float length_ofJetter t int num_dir,int num_of_extrrn) 
{ int temp=0,i,m,count; 
i=num_of_extrm; 

while (aiT_extremomsp].pen_sts— 0) 

i-; 

while (arr_extremoms[i].pen_sts=1) 

; 

if (i<«0) return(temp); 
else 

{ for (count=0;count<num_dir;count++) 

{ if (0> ts ARR_DlR[count].pns_beg)&&(i<=ARR_DIR[count].pns_end)&& 
((float)ARRJDIR[count].length/length_ofJetter < TRESH_F3)) 
{ for (m«ARR_DIR|count].pns_beg-1;m<=ARR_DIR[count].pns_end;m++) 
{ arr_extremorns[mJ.pen_sts»0; 
temp=1 ; 
return (temp); 

} 

} 

} 

} 
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return(t mp): 

} 



void start(int num_of_extrms) 
{ int count; 

for (count = 0; count <MAX_AMOUNT_DIREC; count++) 
{ ARR_DIR|count].num = 0; 
ARRJDlR[count].pnsJ>eg = 0; 
ARR_DIR[count].pns_ end = 0; 
ARRJDI R[count] .x_beg = 0; 
ARR_DIR[count].y_beg = 0; 
ARRJ3IR[count].x_end = 0; 
ARR_DIR[count].y_end "= 0; 
ARR_DI R [count] . length = 0; 
ARR_DIR[countj. angle = 0; 
ARRJJ G ATfcount] . n um = 0; 
ARR_LIGAT[count].pns_beg = 0; 
ARR_LiGAT(count].pns_end = 0; 
ARR_LI G ATfcountj .x J>eg = 0; 
ARRJJ GATlcount].yJ>eg = 0; 
ARRJJ GAT[count].x_end - 0; 
ARRJJGAT[countj.y_end = 0; 
ARRJJGAT[count],length * 0; 
ARR_LIG1lcount].num = 0; 
ARRJJG1 [count]. pns_beg = 0; 
ARRJJG1[count].pns_end = 0; 
ARR_LIG1[count].x_beg = 0; 
ARR_UG1[count].y_beg = 0; 
ARRJJ G1[count].x_end = 0; 
ARRJJ G1[count].y_end = 0; 
ARRjJGl[count].length = 0; 
ARRJJG2[count].num = 0; 
ARR_LIG2[count].pns_beg = 0; 
ARRJJ G2[count].pns_end = 0; 
ARR_LIG2[count].x_beg = 0; 
ARR_LIG2[count].y_beg « 0; 
ARRJJG2[count].x_end * 0; 
ARRJJ G2[countj.y__end = 0; 
AR R_LI G2[co unt] . length = 0; 
ARRJJG3[count].num = 0; 
ARRJJG3[count].pnsJ>eg = 0; 
ARR_UG3[count].pns_end «= 0; 
ARR_LIG3[count].xJ>eg = 0; 
ARR_LIG3[count].y_beg = 0; 
ARRJJG3[count].x_end = 0; 
ARRJJG3[count].y_end = 0; 
ARRJJG3[count]. length = 0; 

> 

for (count = 0: count <=num_of_extrms; count++) 
{ penn[count].strkjium = count; 

penn[countj.p_ndx = arr_extremoms[count].pjidx; 
penn[count].form_code = 0; 

penn[count].pen_sts = arr_extremoms[count].pen sts; 

} 

} 



57 



EP 0 666 543 A2 



/-*•*—« 

function ligatO defines I ft up strokes from the end of long down 

in the arr_extremomsQ, records defined left up stroke's paramet rs to 

^ ^^^y ,?, 3 !!? 0 ^'" 9 tQ hiS number a ' nd labels MASK penn. 

int ligat(tnt num_of_extrms,int num_dir) 
{ int pr,numJig f num_pns.count,num_str; 

pr = 0; 

num_pns = 0; 
nunrMig = 0; 
if (num_dir == 0) 
return(O); 

for (count = 0; count < num_dir; count-*-*-) 
{ 

pr = 0; 

if (ARR_DIR[count].pns__end — (unsigned)O) continue; 
. if (penn[ARR_DIR[count].pns_end].form_code==(unsigned)0) continue; 
if (an_extremoms[ARR_DIR[count].pns_end+1].dir > 2) continue; 
if (arr_extremoiTO[ARR_DIR[count],pns_end].pen_sts == (unsigned)O) 

continue; 

for (num_str = ARR_DIR[count].pns_end+1; num_str <= num_of_extrms; 

num_str++) 

{ if ((an_extrernoms[num_str].dir <= 2) 

&&(penn[num_str].form_code =<= 0)) 

{ if (pr==0) 

{ ARR_LIGAT[num_lig].num = numjig; 
ARR_LIGATlnum_Dg].pns_beg - num_str; 
ARR_LIGAT[num__fig].x_beg = an_extremoms[num_str-1].x_cor; 
ARRJJGATlnumJig].y_beg « an_extremoms[num_str-1].y_cor; 
ARR_LIGATlnurnJig].pns_end = num_str; 
ARR_LIGAT[num_lig]jc_end = an_extremoms[num_str].x_cor; 
ARRJJGAT[num_lig].y_end = an_extremoms[num_str].y_cor; 
pr= 1; 
num_pns-*-»-; 

penn[num_str].form_code = 3; 
if ((num_str==num_of_extrms)|| 

(arr_extremoms[num_str].pen_sts (unsigned)O)) 
{ num_lig++; 
pr = 0; 
break; 

} 

} 

else 

{ rARR_LIGAT[num_fig].dir « ARRJJGAT[count].dir + 

arr_extremoms[num_str].dir;*/ 

num_pns-*-+; 

pen n [n um_st r] . f o rm_cod e = 3; 

if (( aiT_extremoms(num_str].pen_sts == (unsigned)0)|| 

(num_str==num_of_extrrns)) 
{ rARR_LIGAT[num_lig].pen_sts = arr_extremoms[num_str].pen_sts;V 

ARR_LIGAT[numJig].pns_end «= num_str; 

ARRJJGAT[numJig].x_end = aa_extremoms[num_strl.x_cor; 

ARR_LIGAT[numJig].y_end = an_extremoms{num_str].y_cor; 

num_iig++; 

pr = 0; 
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break; 

} 

- } 

} 

else 

{ >f (pr*=1> 

{ ARR_LIGAT[numJifl].pns__end = num_str-1 ; 

ARRJJGAT[numJig].x_end = an_extremoms[nurn_str-1].xj:or; 

ARRJJGAT[numJig].y_end = arr_extremoms[num_str-1].y_con 

numjig++; 

pr = 0; 

break; 



15 } 



} 

} 



} 

return(num_lig); 



function ord_J_figatO defines one order left up strokes from the 
end of left up strokes in the arr_extremomsfl, records one order 
left up stroke's parameters to ARR_ORD_1 JJGATfl according to his 
number and labels MASK penn. 

int ord_1 Jigat(int num_of_extrms,int numjigat) 
{ int pr,numJig,numj3ns,count,num_str; 

pr = 0; 
30 num_pns = 0; 

nurnjig = 0; 
if (numjigat « 0) 
return(O); 

for (count = 0; count < numjigat; count++) 
{ 

pr = 0; 

if (ARRJJGAT[count].pns_end == (unsigned)O) continue; 
if (penn[ARR_UGAT[count].pns_end].form_code=(unsigned)0) continue; 
If ((arr_extremoms[ARR_LIGATIcount].pns"end+1].dir > 4)|| 

(arr_extremoms[ARR_LIGAT[count].pns_end+1].dir < 2)) continue; 
if (an_extremoms[ARR_LIGAT[count].pns_endJ.pen_sts == (unsigned)O) 

continue; 



for (num_str = ARRJ_IGAT[count]-pns_end+1; num_str <= num_of_extrms; 

num_str++) 

45 {if ((arr_extremoms[num_str].dir <= 4) 

&&(arr_extremoms[num_strl.dir >= 2) 
&&(penn[numjstr].form_code == 0)) 

{ if (pp-0) 

so { ARR JDRD_1 JJ GAT[numJig] . num = nurnjig; 

ARR_ORDJ JJ G AT[num Jigj.pns J>eg = numjstr; 

ARRJ3RD_1JJGATlnumJig].xJ>eg = arr_exfremoms[num_str-1J.x cor; 

ARR_ORD_1 JJGAT[numJig].yJ>eg = arr_extr moms[num_stM]\yj;or; 

ARRJDRDjI JJGAT|numJig].pns_end = nun\_str; 
55 ARR_ORD_1 jJGAT[numjig].x_end = arr_extremoms[num_str].x_cor; . 

ARR_ORDjl JJGAT[numJig].y_end = arr_extremoms[num strj.y cor 

pr=l; " 
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num_pns-M-; 

penn(num_str].form_code « 11; 
if ((num_str==num_of_extrms)|| 

(arr_extremoms(nun\_str).pen_sts == (unsigned)O)) 
{ num_lig++; 
pr = 0; 
break; 

} 

} 

else 

{ TARR_ORD_1 JJGAT[num_lig].dir « ARR_ORD_1 JJGAT[countJ.dir + 

arr_extremoms[num_str].dir t V 

num__pns++; 

pennlnum_str].form_code = 11; 

if (( arr_extremorns[num_str].pen_sts == (unsigned)0)|| 

(num__str==num_of_extrms)) 
{// ARR_ORD_1 JJGAT[numJig].pen_sts = arr_extremoms[nurn_str].pen_sts; 
ARR_ORD_1_UGAT[numJigJ.pns_end * num_str; 
ARR_ORD_1 J_l G AT[num_ligj .x_end = arr_extre moms [n u m__str] .x_co r; 
ARR_ORD_1 _LI GAT[num_ligj .y_end a rr_ext remoms [n u m_str] .y_cor; 
(unsigned)ARR_ORD_1JJGAT[numJig].dir/num_pns; 
num_ltg++; 
pr«0; 
break; 

} 

} 

else 

{ if (pr=»1) 

{ ARR_ORD_1_UGATInum_Jig].pns_end = num_str-1; 

ARR_ORD_1_LIGATlnum_fig].x_end = arr_extremoms[num_str-1].x_cor; 
ARR_ORD_1 JJGATJnum_fig].y__end «* arr_extremoms[num_str-1].y_cor; 
num_lig++; "~ 
pr = 0; 
break; 

} 

} 

} 

} 

return(nurn_lig); 

} 



r " 

function figl 0 defines right up strokes from the begining of long 
down in the arr_extremomsQ, records defined right up stroke's 
parameters to ARRJJG1Q according to his number and labels MASK 
penn. 



int ligl(int num_of_extrms,int num_dir) 
{ int pr l nun\_lig,num__pns f count,num_str; 
unsigned temp; 

pr « 0; 

num_pns = 0; 
num_lig = 0; 
if (num_dir == 0) 
retum(O); 
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ARR_ORD_1JJG1[num_lig].x_end = arr_extremoins[nunri_str].x_cor; 
ARRJ3RD_1JJG1[numJig].y_end = arr_extremoms[num_st^y_cx>n 
pr=1; 
num_pns++; 

penn[num_str].form_co(je = 12; 
if ((num_str==1) 

||(arrlextremoms[num_str-1].pen_sts == (unsigned)O)) 
{ num_lig++; 
pr = 0; 
break; 

} 

} 

else 

{ TARR_ORD_1_UG1 [numjgj.dir - ARR_ORD_1_UG1 Icountl.dir + 

an_extremoms[num_str].cfin"/ 

num_pns++; 

penntnum^str] .form_code = 12; 

tt (( aiT_extremoms[num_str-1].pen_sts ~ (unsigned)0)|| 
(num_str«1)) 

{ //ARR_ORD_1 JJG1 [numjig].pen_sts = arr__extremoms[num_str].pen_sts; 
ARR_ORD_1JJG1[num_fig].pns_end = num_str; 
ARR_ORD_1 JJG1lnum_ligj.x__end = arr_extremoms[num_str]Jc_cor; 
ARR_ORDjt JJG1lnum_Bg].y_end = arr_extremorns[num_strl.y_cor; 
num_Iig++; 
pr = 0; 
break; 

} 

> 

} 

etse 

{ if (pr«=1) 

{ ARR_ORD_1„LIG1[numJig].pns_end = num_str+1; 

ARR_ORD_1_UG1[numJig].x_end «= arr_extremoms[n um_str+ 1 ] .x_cor; 

ARR^O RD_1 _U G 1 [n u m Jig] ,y_end = arr_extrernoms[num_str+1] .y_cor; 

numJig-M-; 

pr « 0; 

break; 

) 

} 

} 

} 

for (count=0; count<numJig; count++) 
{ temp = ARR_ORDjlJJG1[count].x_end; 

ARR_ORDJJJG1[count].x_end = ARR_ORDJI_UG1 [count] .x_beg; 
ARR_ORD_1 JJG1(count]j(j3 e 9 = temp; 

temp * ARR_ORD_1_UG1 [count] .y_end; 

ARR_ORDJJJG1[count].y_end = ARR_ORD_1JJG1 [count] .y_beg; 
ARR_ORD_1JJG1 [count].y_beg = temp; 

temp = ARR_ORD_1_UG1[count].pns_end; 

ARR_ORD_tJJG1[count].pns_end = ARR_ORD_1JJG1[count].pns_beg; 
ARR ORD_lJJGl[count].pns beg = temp; 

} 

return(num_fig); 



EP 0 666 543 A2 



function Iig20 d fines left up strokes from the begining of 
long down in the arr_extremomsQ t records defined left up stroke's 
parameters to ARRJJG2Q according to his number and labels 
MASK penn. 



int Iig2(int num_of_extrrns,int num_dir) 
{ int pr.numjig.num _pns,count,num_str; 
unsigned temp; 

pr = 0; 

num_pns = 0; 
numjig = 0; 
if (num_dir ==0) 
return (0); 

for (count = 0; count < num_dir; count++) 
pr - 0; 

if (ARR_DIR[count].pns_beg < (unsigned)2) continue; 
if (pennlARR^DIRIcountJ.pns^begJ.form^des^) continue; 
if (arr_extremoms[ARR_DIR[count].pns_beg-1].dir > (unsigned)2 ) 

continue; 

if (pennlARR^DIRfcountJ.pns^beg-IJ.form^codei^O) continue; 
if (arr_extremoms[ARR_D[R[count].pns fc beg-1].pen_sts == (unsigned)O) 

continue; 

for (num_str = ARR_DIR[count].pns_beg-1; num_str >= 1; 

num_str— ) 

{ if ((arr_extremoms[num_str].dir <= (unsigned)2 ) 
&&(penn[num_str].form_code==0)) 

{ if (pr==0) 

{ ARR_LIG2[numJig].num = numjig; 
ARRJJG2[numJig].pns_beg = num_str; 

ARR_L1G2[num_lig].x_beg * arr_extremoms[num_str+1].x_cor; 
ARR_LIG2[numJig].y_beg = arr_extremoms[num_str+1].y_cor; 
ARRJJG2[numJig].pns_end « num_str; 
ARRJJG2[num_lig].x_end = arr_extremomslnum_str].x_cor; 
ARRJJG2[numJig].y_end = arr_extremoms[num_str].y_cor; 
pr - 1; 
num_pns++; 

penn[num_ str].form_code = 7; 
if ((num_str==1) 

||(arr_extremomsInum_str-1].pen_sts == (unsigned)O)) 
{ num_lig++; 

pr = 0; 

break; 

} 

} 

else 

{r ARR_LIG2[numJig].dir = ARR_UG2[count].dir + 

arr_extremoms[num_str] .dir;*/ 

num_pns++; 

penn[num_str].form_code = 7; 

if (( arT_extremoms[num_stM).pen_sts == (unsigned)0)|| 
(num_str==0)) 

{// ARR_L1G2[numJig].pen_sts = aiT_extremorns[num_str].pen_sts; 
ARR_LIG2[numJigl.pns_end = num_str; 
ARR_LIG2[num_1ig].x_end = arr_extremoms[num_str].x_cor; 
ARR_LIG2[num_!ig].y_end « arr_extremoms[num_str].y_cor; 
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numjig++; 
pr = 0; 
break; 

} 

} 

} 

else 

{ if <pr==1) 

{ ARR_LIG2[numJig].pns_end = nurn_str+1; 

ARR_LIG2[numJig].x_end = aiT_extremoms[num._str+1].x_cor; 

ARR_LIG2[num_Hg].y_end = an , _extremoms[num_str+1].y_cor; 

num_lig++; 

pr - 0; 

break; 

} 

} 

} 

} 

for (count=0;count<num_lig;count++) 
{ temp = ARR_LIG2[count].x_end; 
ARR_UG2[count].x_end = ARRJJG2[count].x_beg; 
ARRJJG2[count].x_beg - temp; 

temp =* ARR_LIG2[count].y_end; 
ARR_L!G2(count].y_end = ARRJJG2[count].yj3eg; 
ARRJJG2[count] .y_beg = temp; 

temp = ARR_LIG2[count].pns_end; 
ARR_L!G2[count].pns_end « ARR_LIG2[count].pns_beg; 
ARR_LIG2[count].pns_beg « temp; 

} 

return(nurn_lig); 

} 

r * "* 

function ord_1 Jig20 defines one order left up strokes from the 
begining of left up strokes in the a rr_extremomsQ, records one 
order left up stroke's parameters to ARR_ORDJMJGlQ according 
to his number and labels MASK penn. 

int ord_1_Jig2(int num_of_extrms,int numjig2) 
{ int pr 1 numJig,num_pns,count,num_str; 
unsigned temp; 

pr = 0; 

num_pns = 0; 
num_lig = 0; 
if (numjig2 — 0) 
retum(O); 

for (count = 0; count < num Iig2; count++) 

{ ~ 
pr = 0; 

if (ARRJJG2[count].pns_beg < (unsigned)2) continue; 
if (penn[ARR_LIG2[count].pns_beg].form_code==0) continue; 
if ((air_extremoms[ARRJJG2[count].pns_beg-1].dlr < <unsigned)2 ) 
||(arr_extremoms[ARR_LIG2[countJ.pns_beg-l].dir > (unsigned)4 )) 

continue; 

if (penn[ARRjJG2|countJ.pns_beg-1) Jorm_code!==0) continue; 
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if (arr_extremomslARR_LIG2[count].pns_beg-1].pen_sts ~ (urisigned)0) 

continue; 

for (nun\_str = ARRJJG2[count].pns_beg-1; num_str >= 1; 

num_str— ) 

{ if ((arr__extremoms[num_str].dir <= (unsigned)4 ) 

&&(arT_extremoms[num_str].dir >= (unsigned)2 ) 
&&(penn(num_str].form_code==0)) 

{ it (pr==0) 

{ ARR_ORD_1_LIG2{numJig].num = numjig; 
ARR_ORD_1_LIG2[numJig].pns_beg e num_str; 
ARR_ORD_1_LIG2[numJigj.x_beg «= arr_extremoms[num_str+i].x_cor; 
ARR_ORDJJJG2[numJig].y_beg = arr_extremoms[numIstr+1].y"cor; 
ARR_ORD_1_UG2[numJig].pns_end = num_str; 
ARR_ORD_l JJG2[num_lig].x_end = arr_extremoms[num_str]jc_cor; 
ARR_ORD_1JJG2[numJig].y_end = aiT_extremomslnum_str].y_cor; 
pr - 1; 

penn[num_str].form_code = 13; 
if «num__str==1) 

||(arr_extremoms[num_str-1].pen_sts == (unsigned)O)) 
{ num_lig++; 

pr = 0; 

break; 

} 

} 

else 

{r ARR_ORD_1JJG2[numJig].dir = ARR_ORD_1JJG2lcount).dir + 

aiT_extremoms[num_str].dir;7 

num_pns++; 

penn[num_str].form_code = 13; 

if (( air_extremoms[num_str-1].pen_sts (unsigned)0)|| 
(num_str==0)) 

{ //ARR_ORD_1_LIG2[numJig].pen_sts = a rr_ext remo ms[n u m_str] . pe n_sts ; 
ARR_ORD_1 JJG2[numJig].pns_end = ntim_str; 
ARR_ORD_1 JJG2[numJig]jc_end = anr_extremoms[num_str].x_cor; 
ARR_ORD_1_UG2[num_lig].y_end = arr_extremoms[num_str] .y cor; 
(unsigned)ARR fc ORD_1_LIG2[num_tig].dir/num - pns; 
numjig++; 
pr= 0; 
break; 

} 

} 

} 

else 

{ if (pr==1) 

{ ARR_ORD_1 JJG2[numJig].pns_end = nurn_str*1; 

ARR_ORDJ JJG2[numJig].x__end = arr_extremomslnum_str+1].x_cor; 

ARRJDRD_1 JJG2[num_lig].y_end = arr_extremoms{num_str+l].y_cor; 

numjig+n-; 

pr « 0; 

break; 

} 

} 

} 

} 

for (count=0;count<num_lig;count++) 
{ temp * ARR_ORD_l j_IG2[count].x_end; 
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ARR_ORDJ JJG2[count].x_end « ARRJDRDJ_LIG2[count].xJ>eg; 
ARR_ORD_1 J_IG2lcount].x_beg = temp; 

temp « ARR_ORD_t_UG2[count].y_end; 

ARR_ORD_1JJG2[count].y_end = ARR_OFUDJI_LIG2[count].y_beg; 
ARR_ORD_1 JJG2[count].y_beg = temp; 

temp ■ ARR_ORD_1_LIG2[count}.pns_end; 

ARR_ORD_1 J_IG2lcount].pns_end = ARR_ORD_1_UG2[count].pns_beg; 
ARR ORD 1_UG2[count].pns_beg = temp; 

} 

retum(numjig); 

} 

function Bg30 defines right up strokes from the end of long 
down in the arr_extremomsQ, records defined left up stroke's 
parameters to ARR_LIG3Q according to his number and labels 
MASK penn. 

/ 

int Iig3(int num_of_extrms,int num_dir) 
{ int pr^numjig.numjpns.count.num^str; 

pr « 0; 

num _pns = 0; 
numjig = 0; 

if (num_dir ==0) , 
return(O); 

for (count « 0; count < num_dir; count++) 
{ 

pr s 0; 

if (ARR_DIR[count].pns_end «« (unsigned)O) continue; 

if (penn[ARR_DIR[count].pns_end].form_code«=«(unsigned)0) continue; 

if ((air_extremoms[ARRJ3lR[count].pns_end+1].dir > 4) 

||(arr_extremoms[ARR_DIR[count].pns_end+1J.dir < 2)) 
continue; 

if (penn[ARR_DIR[count].pns_end+1].form_code!=0) continue; 
if (arr_extremoms[ARRJDIR[count].pns_end].pen_sts = (unsigned)0) 

continue; 

for (num_str = ARR_DIR[count].pns_end+1; num_str <= num_of_extrms; 

num__str++) 

{ if ((arr_extremoms[num_str].dir <= 4) 

&&(an_extremoms[num_str].dir 2} 
&&(pennlnum_str].form_code == 0)) 

{ if (pr==0) 

{ ARRJJG3[numJig].num = numjig; 
ARRJJG3[numJtg].pns_beg = num_str; 
ARRJJG3[numJig].x_beg - arr_ extremorns[num_str-1].x_cor; 
ARRJJG3{numJ|g].y_beg = arr_extremoms[num_str-1].y_cor; 
ARRJJG3[numJig].pns_end = num_str; 
ARRJJG3[numJig].x_end = arr_extremoms[num_str].x_cor; 
ARRJJG3[numJig].y_end « aiT_extremorns[num_str].y cor; 
pr = 1; 
num_pns++; 

penn[num_str).form_code * 9; 
if ((num_str==num_of_extrms)|| 

(arr_extremoms[num_str].pen_sts « (unsigned)O)) 
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^} ^ 

fp=fopennextr.our\ ,, ab+ w ); 
fprintf(fp.-%d %c %d %d", 

map_char[letter_num][1],netter) f num_direc,num.oLextrms); 
for (i=0;i <=: num_of_extrms;!-M-) 

fwrite(&arr_extremoms[i] ? sizeof (struct TABLE EXTREMOMS),1 ,fp); 
fpnntf(fp ) ' , Vn-); 
fclose (fp); 

fp=fopenneat.our i "ab+"); 

fprintf(fpr%c %d % .4f % .4f % .4f % .4fVn", 

rietteO.map^charltetter^numlllJ^^ve^beg.y^vec^end, 

x_vecJ>eg F x_yec_end); 

fclose (fp); 

fp=fopenCfeat1 .ouTrab+ w ); 
fprintf(fp,"%c %d %d\rT, 

rietter),map_char[letter_num][1],amp_y); 

fclose (fp); 
/•— / 
If (num_direc==0) 

fp=fopen ffsentO . our , H ab+") ; 
If (num_direc==1) 

fp=:fopenffsent1 .outTatH-**); 
if (num_direc==2) 

f p=f open f fsent2.our,**at>+") ; 
if (num_direc==3) 

fp«fopen^tsent3.our l i *ab-K ,, ); 
if (num_direc==4) 

fp=fopenrfsent4.out ,, ( "ab+ w ); 
if (num_direc==5) 

fp=fopennsent5.outVafcH-"): 
if (num_direc==6) 

fp=fopenCfsent6.outVab+ w ); 
fprintf(fp,*%d %c w ,map_char[letter_num][1] ) netter)); 
if (nurn_direc!=0) 
{ fprintfffp.^s w ,our_sent); 
for 0=O;i<num_direc;i++) 

fprintf(fp.-%.4f %.4f w ,x[i].x_b,x[i].x_e); 
for (i«0;i<num_direc;i++) 

fprintf(fp "%.4f % 4f ",y0].y_b.yrij.y_e); 
fprintf(fp, H %d",amp_y); 

} 

fprintf(fp, w \n w ): 
fclose (fp); 

} 

int add_map (char *letter) 
{ 

int i; 

for 0-0;i<NUM_SYMBOLS;i++) 
if rtettep==(char)map_char[i][OJ) 
{ map_char[iJ[1J++; 
return(i); 

} 

if (i==NUM_SYMBOLS) 
{ printf("There is no such character in the map %c\n" "letter); 
return(-1): 
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} 

retum(-1); 

} 

void read_map(void) 
{ 

FILE *fp; 
int i; 

fp=fopenCmap_chVrb H ); 

for (i=0; i<NUM_SYMBOLS;i++) 

fscanf(fpr%d %d\n* l &map_charpl[0],&map_charpl[1]); 
f close (fp); 

} 

void save_map(void) 
{ 

FILE *fp; 
int i; 

fp=fopen("map_ch' , l ' x wb"); 

for (i=0; i<NUM_SYMBOLS;l++) 

fprintf(fp,-%d %d\n",map_charp][0],map_char[ilI1l); 
fclose(fp); 

} 

int get_num (char *letter) 
{ 

int i; 

for fi=0;i<NUM_SYMBOLS;i++> 
if (*letter=«(char)map_char[i][Ol) return(i); 
return(-1); 
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HI. Generargation 

void main(void) 
{ 

FILE *fp/fp1; 
int i; 

char filename[30}, filename - ! [30]; 
read_map0; 

for (i=1;i<=MAX_AMOUNT DlREC;i*M-) 

{ >f 0—1) 

{ strcpy(filename, M feent1.out M ); 
strcpy (filename 1 ( "fgen1.ouT); 

printff %d \n"j); 

goto A; 

} 

if (I—?) 

{ strcpy(filename,"fsent2.oiir); 
strcpy(filename1 l M fgen2.out M ); 

prirrtfC — %d \n",i); 

goto A; 

} 

if (1—3) 

{ strcpy(filename,'fsent3.out M ); 
strcpy(filename1 .tgenS.out"); 

printff %d \n",i); 

goto A; 

} 

if (|==4) 

{ strcpy(filename ( "fsent4.ouT); 
strcpy(filename1 /fgen4.our); 

printff %d WJ); 

goto A; 

} 

if 0—5) 

{ strcpy(fjlename l n f&ent5.out N ); 
strcpy(filename1 /fgenS.out"); 

printff %d W.i); 

goto A; 

> 

if (M) 

{ strcpy(filename, M fsent6.oiit"); 
strcpy(filename1 ,"fgen6.our); 

printff %d \n",i); 

goto A; 

> 

A: fp1 =fopen(filename1 f "wb"); 
fclose(fpl); 

gener(i,filename,filename1); 

} 

fp1 =fopenf genfeat.our.'Vrtr); 

fclose(fp1); 

gener_feat0; 

fp1 «fopenf genfetl .ouf^b"); 

fclos (fp1); 

gener_feat1Q; 
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void read_map(void) 
{ 

FILE -fp; 
int i; 

fp=fopenCmap_chVrb"); 

for (i=0; i<NUM_SYMBOLS;i++) 

fscanf(fp.-%d %d\n",&map_char[i][0],&map_char[fJ[1J); 
fclose(fp); 

} 

void gener(int i.char filename[],char filenamein) 
{ 

void gether(char letter,int num_dir,char filenameQ.char filenamelfl); 
int j; 

for 0=OJ<100J++) 
{ if (map_charflj[1]>0) 
gether(map_charfl][0]J,filename .filename!); 

} 

void gener_feat(void) 
{ 

void gether_feat(char letter); 
int j; 

for (j=0;j<100^+-+) 
{ if (map_char[fl[1]>0) 

gether_feat(map_char[j][0]); 

} 

} 

void gener_feat1 (void) 
{ 

void gether_feat1(char letter); 
int j; 

for O=0;j<100;j++) 
{ if (map_char[D[1J>0) 
gether_feat1 (map_char[fl[0]); 

} 

void gether(char letter.int num_dir,char filenamefl.char filenamein) 
{ char ch; 

int letter_num; 

int i, amount; 

int amp_y; 

FILE *fp; 

int conv(void); 

void conv_dir_defin(int amount.int num_dir); 
void write_to_gen(int amountjnt num_dir,char letter); 
void save_gen(int num_dir,char letter^char filename1Q); 
void save_xy(int num_dir % char filenamelfl); 

amount=0; 
gen.repr.num=0; 

for (i=0;i<=MAX_AMOUNT_DIREC;i++) 

gen.repr.tabl[g.number=0; 
fp-fopenCfilename^rb"); 
while (fscanf(fp,"%d" ( &letter_num)!=EOF) 
{ fscanf(fp," %c *\&ch); 

fscanf(fp,"%s "\our_sent); 

for (i sa O;i<num_dir;i++) 
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fscanf(fp,"%f %f ",&bx[amount][i].x - .b f &bxIamount]ni.x_e); 
for (i=0;i<num_dir;j++) 

fscanf(fp,-%f %f ",&by[amount][i].y_b,&by[amount][0.y_e); 
fscanf(fp f -%d\n M ,&amp_y); 

if (ch==letter) 
{ convQ; 

write_to fc jgen(amount 1 num_dir-1 .letter); 
amount-*-*-; 

if (amount==MAX_REPRESNT) 
{ fclose(fp); 
break; 

} 

} 

} 

fclose(fp); 
if (amount>0) 

{ conv_dir_defin(amount,num_dir); 
save_gen(num_dir,letter t filename1); 
save_xy(num_dir,filename1); 

} 

} 

void save_jgen(int num_dir,char letter.char filename - ! Q) 

FILE *fp1 ; 
intij; 

fp1 =fopen(filenarne1 ; t ab+"); 
fprintf(fp1, w %cMetter); 

fprintf(fpV%d %c %d w ,gen.amount,flen.repr.letter,gen.repr.num); 
for (i=0;i<=nun>_dir;i++) 
{ fprintf(fp1 ,"%d fc ,gen.repr.tabf[i].number); 
if (gen.repr.tabl[i].number>0) 
{ for O=0;i < gen.repr.tab!p].numberj++) 

fprintf(fp1 ,"%s w ,gen.repr.tab![i].rowO].str); 
fprintf(fp1 I "Vn w ); 

} 

} 

fclose(fpl); 



void save_xy(int num_dir,char filename! m 
{ FILE-fp1; 
int i; 

fp1«=fopen(filenam©1 f H ab+"); 
for (i=0;i<num_dir;i++) 

fprintf(fp1,"%T4f %.4f M ,x - mid!![i].x_b ( x_midil[i].x - _e); 
for (i=0;i<num_dir;i++) 

fprintf(fp1,*%.4f %.4f M .x_dev[i].x.b,x.dev[i].x_e); 
for (t=0;i<num_dir;i++) 

fprfntfCfp1 v av %74f %.4f w ,y.midll[i].y_b t y_midliri].y_e); 
for (i=0;i<num_dir;i++) 

fpnntf(fp1 f w %.4f %.4f \^y_devn7_b,y_dev|il.y_ ); 
fclose(fpl); 

} 
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v id sav _feat1(char letter) 
{ FILE*fp1; 
int i; 

1p1 =f openfgenfeat.out* ,"ab+") ; 
fprintfffpVfcc ".letter); 

fprintf(fpV%4f %.4f %.4f %.4f\n"pc_midlIl0lJC_b^_midII[0].x_e t 

y_midl![0].y_b 1 y_mida[0].y_e); 

for (i=0;i<3;H-+) 

{ fprintftfpl.-^f %.4f %.4f %.4f\n",x_dev[q.x_b t x_devli].x_e ( 

y_dev[i].y_b,y dev[Q.y_e); 

} 

fclose(fpl); 

} 

void save_feat2(char letter) 
{ FILE*fp1; - 
int i; 

fp1 =fopen("genfet1 .outVab+ N ); 
fprintf(fp1 ,"%c ^.letter); 

fprintf(fpV%.4f %d %d\n w 1 y_midII[0].y_b l amp_y[0] l ampjy[1D; 
for (i=0;i<3;H-+) 

fprintf(fp1 "%.4f n ,y_dev[i].yJ>); 
fprint^fpl^n"); 
fclose(fp1); 

} 

void gether_feat(char letter) 
{ 

void calc_vec(int amount); 

FILE*fp.fp1; 

int amount,letter_num; 

char ch; 

amount=0; 

fp^fopenCfeatoutVrb"); 

while (fecanftfp.^c-.&c^l^EOF) 
{ fecanf(fp," %d %f %f %f %nn w ,&letter_num, 

&by[amount][0].y_b r &by[amount][0].y_e i 
&bx[amount][0].x_b,&bx[amount][0].x_e); 

if (ch==letter) 
{ amount-*-*; 

if (amount— M/OC_REPRESNT) break; 

} 

} 

fclose(fp); 
if (amount>0) 
{ calcvec(arnoiint); 
save_feat1 (tetter) ; 

} 



void gether feat1(char letter) 
{ 

void calc_amp(int amount); 
FILE fp; 

int amount,letter_num; 
char ch; 

amount=0; 
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by[i][count].y_e; 
summ_4=summ_4+temp*temp; 

} 

x_dev[count] .x_b=sqrt(summ_1 /(ftoat)amount) 
y_dev[count].y_b=sqrt(surnm_2/<float)amount); 
x_dev[count]jc_e=sqrt(summ_3/(float)amount); 
y_d ev[cou nt] .y_e=sqrt(summ_4/(float)amount) ; 

} 

return; 

} 

void calc_vec(int amount) 
{ int count.i; 

float sumrnj=0.0; 

float summ_2=0.0; 

float summ_3=0.0; 

float sumn\4=0.0; 

float summjm=0.0; 

float summ_2m=0.0; 

float summ__3m=0.0; 

float summ_4m=0.0; 

float temp; 

int ami .arr^amS.arTVl.amS.amS.amT.amB; 

if (amount>0) 
for (i=0; i<amount 
{ summ_1=summ_1+bx[Q[0].x_b; 
summ_2=summ_2+by[i][0].y b; 
summ_3=summ_3+bx[i][0].x_e; 
s umm_4=su mm — 4+ by [Q [OJ ,y_e ; 

x_midll[0).x_b=summ_1/(float)amount; 
y_midll[0].y_b=summ_2/(float)amount; 
x_midll[0].x_e=summ_3/(fioat)amount; 
y_midll[0] y_e=summ_4/(float)amount; 

summ_1=0.0; 

summ_2=0.0; 

SLimrn_3=0.0; 

summ_4=0.0: 

summ_1m=0.0; 

summ_J2m=0.0; 

summ_3m==0.0; 

surnm_4m=0.0; 

am1=0; 

am2=0; 

am3=0; 

am4*0; 

am5=0; 

am6=0; 

am7=0; 

amS=0; 

for (i=0; i<amount; 
{ temp=x_midll[0].x_b-bx[i][0].x_b; 
if (temp>0.0) 

{ summ_1=summ_1+temp*temp; 
am1++: 
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} 

Ise 

{ summj m=summ_1m+temp*temp; 
am2++; 

} 

temp^_midl![OJ.y_t>-bypl[0].y_b; 
if (temp>0.0) 

{ summ_2=summ_2+temp*temp; 
am3++; 

} 

else 

{ summ_2m=summ_2m+temp*temp; 
am4++; 

} 

temp*x_midll[O].x_e-bx[0tO].x_e; 
if (temp>0.0) 

{ summ_3=summ_3+temp*temp; 
am5++; 

} 

else 

{ summ_3m=summ_3m-»-temp*ternp; 
am6++; 

} 

temp=y_mrdlI[0].y_e-by[i][0].y_e; 
if (ternp>0.0) 

{ summ_4=surnm_4+temp w ternp; 

am7++; 

} 

else 

{ summ_4m=summ_4rTH-temp*temp; 
am8++; 

} 

} 

if (ami ==0) x_dev[0] jc_b=0.o; //dev- 

else x_dev[0] .x_b«sqrt(summ_1 /(float)am1 ) ; 

if (am2==0) x_dev[1].x_b=0.0; //dev+ 

else x_dev[1].x_b=sqrt(summ_1 m/(float)am2); 

if ((am1+am2)==0) x_dev[2].x_b=0.0; //dev 

else x_dev[2] JcJ^qrt((sumnrM +summ_1 m)/(f)oat)(am1 +am2» ; 

if (am3==0) y_dev[0].y_b-0.0; //dev- 

else y_dev[0].y_b=sqrt(summ_2/(float)am3); 

if (am4==0) y_dev[1].y_b=0.0; //dev+ 

else y_dev[1].y_b=sqrt(summ_2m/(float)arr>4); 

if ((am3+am4)==0) y_dev[2].y_b«0.0; //dev 

else y_dev[2].y_b=sqrt((summ_2^umm_2m)/(float)(am3+arn4)); 

if (am5— 0) x_dev[0].x_e=0.0; //dev- 

else x_dev[0] .x_e=sq rt(summ_3/(float)am5) ; 

if (am6~0) x_dev[1].x_e=0.0; //dev+ 

else x_devjl].x_e=sqrt(sunrim_3m/(float)am6); 

if ((am5+am6)==0) x_dev[2]jc_e=0.0; //dev 

else x_dev(2].x_e=sqrt((summ_3+sunrmi_3m)/(float)(am5+arn6)); 

if (am7=0) y_dev[0J.y_e=0.0; //dev- 

else y_dev[0].y_e*=sqrt(summ_4/(float)am7); 

if (am8=0) y_dev[1].y_e=0.0; //dev+ 

else y_dev[1 ].y_e=sqrt(summ_ 4m/(float)am8); 

if ((am7+am8)==0) y_dev[2J.y_e=0.0; //dev 

else y_dev[2].y - e-sqrt((summ - 4+summ_4m)/(float)(am7+am8)); 
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fp=fopenHeat1 .outYrb"); 
while (fecanf(fpr%c".&ch)NEOF) 
{ fecanf(fp," %d %d\n^8Jetter_num,&amp_y|amount)); 
if (ch«letter) 
{ amount++; 

if (a mo u nt==M AX_RE P RE S NT) break; 

} 

} 

fcJose(fp); 
if (amount>0) 
{ calc_amp(amount); 
save_feat2(letter); 

} 

} 

/ *~ 

function conv_dir_definO calculates dispersions of x and y relative 
coordinates in letter skeleton. 

y 

void conv_dir_defin(int amountjnt num_dir) 
{ int countj; 
float summj =0.0; 
float summ_2=0.0; 
float summ_3=0.0; 
float summ_4=0.0; 
float temp; 
if (amount>=0) 

{ for (TOunt=0;count<num_dir;count-M-) 
{ summ_1=0.0; 
summ_2=0.0; 
summ_3=0.0; 
summ_4=0.0; 
for (i=0; i<amount; 

{ sumrnj =summ_1 +bx[i][count].x_b; 
summ_2=summ_2+by[i][count] .y_b; 
summ_3=summJ3+bx[i][count]jc_e; 
sum m__4=s umm_4+ by [i] [co u nt] .y_e; 

} 

x_midlI(count] .x_b=summ_1 /(float)amount; 
y_midll[count].y_b=summ_2/(float)amount; 
x_rnidll[countj.x_e=summ_3/(float)amount; 
y_midll(count].y_e=summ_4/(float)amount; 
surnm_1=0.0; 
summ_2=summ_1 ; 
summ_3*summ_2; 
summ_4=summ_3; 
for (i=0; iomount; 
{ temp=x_midllIcount].x_b- 

bxp]lcount].x_b; 
summj =summj +temp*tenrip; 
temp=y_mtdII[count].y_b- 

byD][count].y_b; 
summ_2=summ_2+temp*ternp; 
temp=x_mtdII[count] .x_e- 

bxpllcount].x_e; 
summ_3=summ_3+temp*temp; 
temp=y_mid!l[count] y_e- 
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{ numjig++; 
pr = 0; 
br ak; 

} 

} 

else 

{ rARR_UG3lnumJig].dir « ARRJJG3[countJ.dir + 

arr_extremoms[num_str] .din*/ 

num_pns++; 

penn[num_str].form_code = 9; 

if (( arr_extremoms[num_str].pen_sts (unsigned)0)|| 

(num_stn==num_of_extrms)) 
{ //ARRJJG3[num_fig].pen_sts « arr_exttemoms[num_str].pen_sts; 
ARR_UG3[nurn_lg].pns_end = num_str; 
ARR_UG3lnunnJig].x_end = an_extremoms[num_str]jc_cor; 
ARRJJG3|num_Bg].y_end « arr_extremoms[num_str].y_cor; 
num_lig++; 
pr = 0; 
break; 

> 

} 

} 

else 

{If (pr"1) 

{ ARR_JJG3[num_Bg].pns_end » num_str-1; 

ARR_LIG3[num_lig].x_end ■» arr_extremoms[num_str-1].x_cor; 

ARR_LIG3[num__0g].y_end = arr^extremomsfnum^str-IJ.y^cor; 

num_Ug++; 

pr = 0; 

break; 

} 

} 

} 

} 

return(numjig); 

} 

/~»~~"~~~ 

function ord_1 Jig30 defines one order right up strokes from 
the end of right up strokes in the arc_extremoms[], records one 
order left up stroke's parameters to ARR_ORD_2JJG10 according 
to his number and labels MASK penn. ~ ~ 

/ 

int ord_1_lig3(int num^o^extrms.int num_lig3) 
{ int pr,numJig.num_pns 1 count ) nurr\_str; 

pr = O; 

num_pns = 0; 
num_lig = 0; 
if (num_lig3 == 0) 
return (0); 

for (count « 0: count < num_lig3; count++) 
{ 

pr = 0; 

if (ARR_LIG3[c unt].pns_end (unsigned)O) continue; 
if (penn[ARR_LIG3[count].pns_end].form - _code==(unsigned)0) continue; 
if (arr_extremoms[ARRJJG3[rountl.pns_end+1].dir > 2) continue; 
if (penn[ARR_LIG3[count].pns_end+1J.form_code!=0) continue; 
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if (air_extrenrtoms[ARRJJG3[count].pns_end].pen_sts ™ (unsigned)O) 

continue; 

for (num_str = ARR_JJG3[count].pns_end+l; num__str <= num_of_extrms; 

num_str++) 

{ If ((arr_extremoms[num_str).dir <= 2) 

&&(arr_extremoms[num_str].dir >= 0) 
&&(penn[num_str] .form_code == 0)) 

{ if (pr==0) 

{ ARR_ORD_1_UG3lnum_lig].num « num_lig; 
ARR_ORD_1 JJG3[numJig].pnsJ>eg « num_str, 
ARR_ORD_1_UG3[numJig]j(_beg = atT_extremomslnum_str-1].x - cor, 
ARR_ORD_1_UG3[num_lig].y_beg » arr_extremoms[num_str-1].y_cor; 
ARR_ORD_1 JJG3[numJig].pns_end = num_str; 
ARR_ORD_1 JJG3[num_Ug].x_end = arr_extremoms[num_str].x_cor; 
ARR_ORD_1 JJG3[num_fig]:y_end « arr_extremoms[num_str].y_cor; 
pr= 1; 
nuinj>ns++; 

penn[num_str].form_code = 14; 
if ((n u m_str= nu m_of_extrms) 1 1 

(arr_extremoms[num_str].pen_sts == (unsigned)O)) 
{ num_Bg++; 
pr « 0; 
break; 

} 

} ' > 

else 

{ TARRJDRD_1_LIG3[numJig].dir *= ARR_ORD_1_LIG3[count].dir + 

arr_extremoms[num_str].din*/ 

num_pns++; 

penn[num_str] .form_code = 14; 

if (( aa_extremoms[num_str].pen_sts — (unsigned)0)|| 

(num_str««num_of_extrrns)) 
{ //ARR_ORD_1 _LI G 3[n um_lig] . pen_sts « a rr_extremoms[n u m_str] . pen_sts ; 

ARR_ORD_1 JJG3[numJig].pns_end = num_str; 

ARR_ORD_1_LIG3(num_lig]jc_end = an_extremoms[num_str] .x_cor; 

ARR_ORD_1JJG3lnumJig].y_end = arr_extremoms[num_str].y_cor; 

num_Iig++; 

pr = 0; 

break; 

} 

} 

} 

else 

{ K (pr*==1 ) 

{ ARR_ORDjl JJG3[numJig].pns_end * num__str-1; 

ARR_ORD_1_UG3[num_lig].x_end = arr_extremoms[num_str- 1 ] Jc_cor, 

ARR_ORD_1_UG3[ruimJigj.y_end = a rr_ext re moms [nu m_str- 1 ] .y_co r; 

num_lig-*-+; 

pr = 0; 

break; 

} 

} 



} 

} 

return(num_fig); 
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r function curveO records to MASK pennfl form code to each of penstrokes 
(exc pt long down) according to its curvature. */ 
void curvefmt num_of_extrms) 

{ extern struct TABLE_EXTREMOMS an_extremoms[MAX_NUM OF EXTREMOMS]" 
int count; " " 

for (count = 0; count « num_of_extrms; count++) 
switch (penn[count].form_code) 
{ case (unsigned)3: 

{ if (air_extremoms[count].in_rot==7) 

penn[count].form_code «= 4; 

else 

{ if ((an_extremoms[count].in_rot==1) 

||(arr_extremoms[count]Jn_rot— 0)) 
penn[count].form_code = 3; 

else 

penn[count].form_code =15; 

} 

continue; 

} 

case (unsigned)5: 

{ if (aiT_extremoms[count].in_rot==1) 

penn[count].form_code = 6; 

else 

{ if ((aiT_extremoms[count].in_rot==7) 

||(arr_extremoms[count].in_rot==0)) 
penn[count].form_code = 5; 
else 

penn[count].form_code =16; 

} 

continue; 

} 

case (unsigned)7: 

{ if (arr_extremoms[count].in_rot— 7) 

penn[count].form_code = 7; 

else 

{ 'f ((arr_extremoms[count].in_rot=1) 

||(arr__extrernoms[count].in_rot==0)) 
penn[count].form_code = 8; 

else 

penn!countJ.form_code = 17; 

} 

continue; 

} 

case (unsigned)9: 

{ if (arr_extremoms[count].in_rot==1) 

penn[count].form_code = 9; 

else 

{ if ((arr_extremoms[count].in_rot==7) 

||(arr_extremoms[count].in_rot==0)) 
penn[count].form_code * 10; 

else 

penn[count].form code = 18; 

> 

} 

default: continue; 

} 

'eturn; 
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if((penn[count]Jorm_code==(un^ 
{ strcpy(ternp,*Y w ); 
strcat(our_sent, " Y~) ; 
goto A; 

} 

if((penn[count]Jorm_code=«(unsigned)18)&&((strcmp(teinprzit=0))) 
{ strcpyflemp ,~Z~); 
strcat(our_sent, w Z"); 
goto A; 

} 

if((p«nn[count]Jorm_code«3)&&((strx»Tip(temp 1 ,, C* , )!=0))) 
{ strcpy(temp,*C"); 
strcat(our_sent f "C); 
goto A; 

} 

tf((penn[count].form_code«4)&&((strcmppemp 1 ,, D")!=0))) 
{ strcpy(temp,Tr); 
strcatCour^senCD"); 
goto A; 

} 

if((penn[count] .f o^m_code==5)&&((strcmp(temp,"E ,, ) !«0))) 
{ strcpy(temp,• , E ,, ); 
strcat(our_sentrE"); 
goto A; 

} 

if((penn[count].form_code==6)&&((strcmp(temprF")!=0))) 
{ strcpy(temp,"F-); 
strcat(our_sent, "F) ; 
goto A; 

} 

if((penn[countJJonn_code^7)&&((strcnip(ternp t ,, G' , )!=0))) 
{ strcpy(temp,"G"); 

strcat(our_sent , "G ") ; 

goto A; 

} 

if ((penn[count] .f oirn_code==8)8A((strcmp(temp ) >0 !=0))) 
{ strcpy(temp,"l-r); 
strcaUour^senCH"); 
goto A; 

} 

if((pennlcount] .form_code==9)&&((strcmp(tempf!") !=0)» 
{ strcpy(temp,"r); 
strcat(our_senVO; 
goto A; 

} 

if((penn(count].form_code==10)&&((strcmp(temp l w J*0!=0))) 
{ strcpy(temp, M J"); 
strcat(our_sent,\T); 
goto A; 

} 

if ((penn{count].pen_sts=0)&&(strcmp(temp,' , _ P, )!-0)) 
{ strcat(our_sent,"_ w ); 

strcpy(temp,"_ w ); 
continue; 

} 

if((penn[count].form_cod ==0)&&(penn|count].p n_sts==1) 

&&((strcmp(temp t H B") !=0))) 

{ strcpy(temprB"); 
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—initial MASK penn have to be build from penstrokes table form_code have 
to be done =0 

record to MASK penn is used in functions : direct.figaUigl.ligZ.ligS, 
ordjljigat.ordjl Jig1 ,ord_1 Jig2,ord_1 Jig3. From these programs 
information for every find form have to be written to MASK for 
these letter. 

outputt - letter representation in the "LETTER SYMBOLIC REPRESENTATION". 
output2 - letter representation in the "LETTER SYMBOLIC REPRESENTATION 
IN GENERALIZED FORM". 

/ 

Int sentense(int num_of_extrms) 

{ extern struct MASK penn[MAX_NUM_OF_EXTREMOMS]; 
extern char our_sent[MAX_LENGTH_SENTENSEJ; 



char temp[10]; 
int count' 

strcpy(our_sent,"* M ); 
strcpy(temp,V): 

for (count=1 ; count <= num_of extrms;count++) 
{ 

if ((penn[countJ .f orm_code«=(unsigned) 1 )&&((st^cmp(temp ^ ' , A ,, ) !=0))) 
{ strcpyOemp^A"); 
strcat(our_sent ."A") ; 
goto A; 

> 

if((penn[counq.form_code==(unsigned)11)&&((strcmp(temp, ,, i")!=0))) 
{ strcpyttemp.-p); 
strcat(our_sent,T); 
goto A; 

} 

if((penn[counq.form_code=(unsigned)12)&&((strcmp(temp, n g M )N0))) 
{ strcpy(temp,-g"); 
strcat(our_sent,"g H ); 
goto A; 

> 

if((penn[countl.form_code==(unsigned)13)&&((strcmp(temp, n r)* s 0))) 
{ strcpy(temp,"r): 
strcat(our_sent,T); 
goto A; 

} 

if((penn[count]Jorrn_code==(unsigned)14)&&((strcmp(tenrip,"d w )!=0))) 
{ strcpy(ternp "d"); 
strcat(our_sent ( M d"); 
goto A; 

} 

if((penn[count}.foiTn_code~(unsigned)15)&&((strcmp(temp. M Q")!=0))) 
{ strcpy(temp,"Q"); 
strcat(our_sent."Q"); 
goto A; 

} 

if((penn|count] .form_code==(unsigned)1 6)&&((strcmp(temp, ,, X") NO))) 
{ strcpy(temprx w ); 
strcat(our_sent/X"); 
goto A: 

} 
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strcatfou^sent'B"); 
continue; 

} 

} 

return(1); 

> 

a funtion that recteves two numbers , and returns the quarter of these 
two numbers in the range of 0..7. 

' IUU1UiUi X l XXl^-L. — ., . >V 

int def_quart (int x,int y) 
{ 

if «x>0 ) && (y==0)) return (0); 
if ((x>0 ) && (y>0) ) return (1); 
if ((x==0) && (y>0) ) return (2); 
if «x<0 ) && (y>0) ) return (3); 
if «x<0 ) && (y=«0)) return (4); 
if ((x<0 ) && (y<0) ) return (5); 
if «x==0) && (y<0) ) return (6); 
if ((x>0 ) && (y<0) ) return (7); 
return (15); 

} 



a function to returns the round number of the division of two integer 
numbers. 

xlL1 " "" * / 

int div_round (int a t int b) 
{ 

int i=0; 

int tempi ,temp2; 

tempi =a; 
temp2=b; 
a=abs(a); 

if (b==0) return (MAXINT); 
while(a>b) 
{ 

if (b>0) a-=b; 
else a+=b; 

} 

if ((a+a)>b) i++; 

if (((tempi >0) && (temp2>0)) || ((tempi <0) && (temp2<0))) retum(i); 

else return (-i); 



void save__files(int num_direc,char *letter) 
{ FILE *fp; 
int i; 

int letter_num; 

char filename[20]; 

int get_num (char 'letter); 

if ((letter_num=g t_num (I tter))<0) 
{ printfCError In the number of th letter %c\n" *letter); 
getchQ; 
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void calc_amp(int amount) 
{ 

int i; 

float summ_l=O.D; 
float summ_1m=0.0; 
float amp_midll,temp; 
int am1,am2; 
int max, mi n; 
max=amp_y[0]; 
min=amp_y[0]; 
if (amount>0) 
for (i=0; i<amount; 
{ summj=summj+amp_y[i]; 

if (amp_y[i]>max) max=amp_y[i]; 

if (amp_y[g<min) min-amp_y[i]; 

} 

amp_midll=summ_1/(float)amount; 
am1=0; 
am2=0; 
summ_1=0.0; 
summ_lm=0.0; 
for (i=0; i<amount; i++) 
{ temp=amp_midll-amp_y[i]; 

if (temp>0.0) 

{ summj =summ_1+temp*temp; 

am1++; 

} 

else 

{ summj m=summ_1 m+temp*temp; 
am2++; 

} 

} 

if (am1«0) y_dev[0].y_b=0.0; //dev- 
else y_dev[0] .y_b=sqrt(summ_1 /(float)am 1 ) ; 

if (am2==0) y_dev[1].y_b=0.0; //dev+ 
else y_dev[1].y_b=sqrt(summ_1 m/(float)am2); 

if ((am1+am2)~D) y_dev[2].y_b=0.0; //dev 

else y_dev[2].y_b=sqrt((summ_1 +summ_1 m)/(fioat)(am1 +am2)); 

y_midll[0].y_b=amp_midlI; 

amp_y[0]=max; 

amp__y[1]=min; 



int conv(void) 
{ char *p; 

int count; 

count=0; 

p=strtok(our_sent, t 7V); 
if (P) 

{ while(p) 

{ strcpy(buf[count],p); 
if (strlen(buf{count])>9) return(O); 
count++; 

p^strtbkfNULLrA"); 
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} 

} 

else 

{ printfCThere is no directions in sentence"); 
getchO; 
return(O); 

} 

return(1); 
} 

// 

// words' generalization 

// * 

int cmpr(char a,char b.const char c,const char d.const char q) 
{ If ((a==c)&&(b==d)||(a==d^ 

(a==d)&&(b==q) 1 1 (a==q)&&(b==d)) 

{ 

return(1); 

} 

else 

return(O); 

} 

int compl (char aQ.char bQ.int i) 



compares! on two letters with the same number in the words a and b 
count - number of letters in words 
" niumx - *~ / 
{ if (a[i]==b[i]) 

{ stmcat(lgt,&bp],1); 
return(1); 

} 

if (cmpr(a[i].b[ii;C , :D , ;Q , )=1) 
{ strcat(lgrCT); 
return (1); 

} 

if <cmpr(a[Q t b[il,^7F7X>=1) 
{ strcat(lgt,"X"); 
retum(1); 

} 

if (cmpr(a[Q l btii:G , ;H-;Y-)==1) 
{ strcat(lgt/Y"); 
retum(1); 

} 

if <cmpr(a[Q,b[iJ/l\\J7Z')===1) 
{ strcat(lgt,"Zl; 
retum(1); 

} 

return (O); 
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int comparCmt num_dir,int count) 



comparison the word with word's row 
k - amount of letters In the words 
j - amount of words in the row 
return: 

777 - word isnt in the row 

0-10 - number of words if there is comparison of the word's part 
222 - word already is in the row 

{ int kj.n.rn.l.temp; 
strcpyflgt,"*); 

for 0=0; j<gen.repr.tabl[count]. number; j++) 
if (strcmp(buflcount],gen.repr.tablIcount].rown].str)==D) 
return (222); 
n=strlen(buf[coLint]); 

for Q~0\ j<gen.repr.tabl[count]. number; j++) 
{ strcpy(lgt,-"); 
m«stiten (gen . repr.tabl[count] . row[j] .str) ; 
if (n=m) 

{ for (k«0; k<=n; k++) 

{ temp=comp1 (buf[count],gen.repr.tabl[count].row[jJ.str,k); 

if (temp==0) 

break; 
else 

if ((temp==1)&&(k=n)) 

{ for (l=0; h=gen.repr.tabI[count]. number; 

if (strcmp(lgt 1 gen.repr.tabl[count].row[r|.str)==0) 
return (222); 

return®; 

} 

} 

} 

else 

{ if 0~gen.repr.tabl[count].number-1) 
retum(777); 

} 

} 

return(777); 

} 



i-number of row ( Oh n front of first direction 

1 - after first dir 

2- after second dir ...) 
~ 1 / 

void write_to_gen(int amountjnt num_dir,char letter) 
{ int i.countj.temp; 
int m,n; 

gen.reprJetter=letter; 
gen.repr.num++; 

for (count=0;count<num_dir+2;count++) 
{ if (gen.repr.tabl[count].number==0) 
{ if (buflcount]!=NULX) 

{ strcpy(gen.repr.tabl[count].row[OJ.str f bufIcounfJ); 
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gen.repr.tabl[count].number++; 

} 

} 

else 

{ temp=compar(num_dir,coiint); 
if (temp==777) 

{ j=gen.repr.tabUcount]. number; 
strcpy(gen.repr.tabI(count].row[fl.str t buf[count]); 
gen.repr.tabt[countl.number++; 

} 

else 

{ if (temp!=222) 

{ // j«gen[ruim_dir] .repr[Q.tabI[counfl.number; 
strcpy (gen . repr.tab![count] .row[temp] .str, Igt) ; 
// gen[num_dir]TepitQ.tab!Icounq.number++: 

} 

} 

} 

} 

return; 
} 



void main(void) 
{ 

int length(int num_dir); 

void cutting(int i.int k,FILE w fpx); 

void add_1(int num_dir); 

char filename1[30]; 

char temp[10]; 

int i,k; 

int num_cutJong; 

fp=fopen("g_cut1 .ouf.^wb"); 
fclose(fp); 

fpsfopenCg^cutZ.ourrwb"); 
fclose(fp); 

fp=fopenCg_cut3 .out" >b") ; 
fclose(fp); 

fp=fopenCg„cut4.outVwb ,t ); 
fclose(fp); 

fp=fopenfg_cut5.outVwb**); 
fclose(fp); 

f p=fopen("g_cut6.our , n wb") ; 
fclose(fp); 

for (i=1 ;i<=6;i++) 
{ strcpy(filename1 l w fgen* , ); 
sprintf^temp.^/od'.O; 
stmcat(filename1 ,temp,1); 
strcat(filename1 .".out"); 

if ((fp=fopen(filename1 ,"r+b^)~ NULL) continue; 

strcpy(filename1 ,"g_cur); 
strncat(filename1 ,temp,1); 
strcat(filename1 .-.out"); 

if ((fp1=fopen(filenameVa+b"))~NULL) continue; 
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add_1(i); 

fclose(fp); 

fclose(fp1); 

} 

for(j=2;i<=6;i++) 

{ st^cpy(fil© name1 . , * ^ 9 en ' , ); 
sprintf(temp"%d" t i); 
stmcat(filename 1 ,temp, 1 ) ; 
strcat(filename1 ".out"); 

if ((fp=fopen(filename1 ( "r+b"))==NULL) continue; 
while ((num_ctrt:jong=length(i))>0) 
{for(k=M;k>=1;k-) 

{ : 
switch (k) 

{ case 1 : fp1 =fopen("g_cut1 .outYa+b-); 
cutting(i.Mp1); 
fclose(fp1); 
break; 

case 2: fp2^openCg_cut2.outYa+b'"}; 
cutting(i f k,fp2); 
fclose (fp2); 
break; 

case 3: fp3=fopenC , g_cut3.outYa+b w ); 
cuttingCiXfpS); 
fclose(fp3); 
break; 

case 4: fp4=fopenCg_cut4.outVa+b"); 
cutting(i ( k t fp4); 
fclose(fp4); 
break; 

case 5: fp5=fopenCg_cut5.outVa+b"); 
cutting(i,k t fp5); 
fdose(fp5); 
break; 

case 6: fp6«fopenCg_cut6.out w "a+b"); 
cutting(i,k,fp6); 
f close (fp6); 
break; 

default: printfCError in cuttingW); getchO; 

} 

} 

} 

fclose(fp); 

} 

} 

void cutting(int ijnt k,FILE *fpx) 
{ void cut_sent(int num_dir); 

void cut_skel(int num__dir,int k); 

void sav_new(int num_ dir.int k,FILE *fp1); 

cut_skel(i t k); 

cut_sent(i); 

sav_new(i.k,fpx); 

} 

int length(int num_dir) 
{ 

int ij; 
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float an_hip[6J; 
char I tt r; 
int pr; 

float temp_fl,w; 
int temp; 

while (fscanf(fp,-%c",&letter)!=EOF) Hetter from gen set*/ 
{ 

fscanf(fp," %d %c %d ,, l &gen.amount,&g(Bn.repr.Ietter,&gen.repr.num); 
for 0 = 0;» <= num_dir;i++) 
{ fscanf(fpr%d *,&gen.repr.tabl[i].number); 

for Q=0*J<gen.repr.tab![i].numberj++) 
fscanf(fp,*%s - f gen.repr.tabl[0.rowfll.str); 

fscanf(fp ( -\n w ); 

} 

for (i=0;i<num_dir;i + +) 

fscanf(ft> ( "%f %f w t &x_midll[i].x_b,&x_mjdlin]jc_e); 
for O ss 0;i<num_dir;i++) 

fscanf(fp ,*%f %f *,&x_devp].x_b ( &x_dev[Q^e); 
for Ci-0;i<num_dir;H-+) 

fscanf(fp,"%f %f M 1 &y„midll[i].y_b,&y_midl1[S].y_e); 
for (i=0;i<num_d!r;i++) 

fecanf(fp,"%f %f \n^yjtevn.y_b,&y_dev[i].y_e); 

for O sr 0;i<num_dir;i++) 
arr_hip[i]=fabs(y_midll[i].y_e.y_midll[i].y_b); 
for C*=0;i<nun)_dir;i++) 
arr_numJong[iH; 

pr=1; 

while (pr==1) 
{pr=0; 

for 0 s num_diM;i>=1;i-) 
{ If (arrjiipfl] < arr_hip[i-1]) 
{ temp_fl=arr_hip[M]; 
aiT_hip[MJ«=aiT_hip[i]; 
arr_hipp] - temp_fl; 
temp=arrjium_long[M ] ; 
an_numJong[M ]=arr_num Jongp]; 
arr_numJong[iJ=temp; 
pn=1; 

} 

} 

} 

w*1.0; 

for (i=0;i<num_dir;i-M-) 
{ coefp]=w*(1.0-arrJiipLi]); 
w=coef[iJ; 

} 

return(1); 

} 

return(-1); 

} 
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void paste(int k,int outnumber .struct STRING out[10],int in_number, 

struct STRING in[10]) 

{ int i j f m,len_out; 
charapO]; 
m=0; 

gen^cut.repr.tabilkj.numbepsout^numberin^number; 
if (gen_cut.repr.tablfk].number>=100) gen_cutrepr.tabl[k].number=99; 
for (N0;i<out_number;H-+) 
for (j=0 j<in_number;j++) 
{ strcpy(a,""); 
len_oLrt=strlen(outp] .str) ; 
if (out[iJ.strtlen_out-1]==inQ].strt0l) 
{ if (len_out>1) 

{ strncpy(a,outp].str l len_out-1); 
a[len_out«1J=W; 

} 

else 
strcpyte,*"); 

} 

else 

strcpy (a , outp] .str) ; 
strcat(a.inQJ.str); 

if (strlen(a) < 10) 

{ strcpy(gen_cut.repr.tabf[k] row[m] .str,a) ; 
if (m>=100) break; 

} 

else 

{ printf("ERR. paste, length of pasted word > 10"); 
getchO; 

} 

} 



num_dir - anishial amount of long. 

k - amount of long, which have to be stay. 

(num_dir-k) - number of loop. 

void cut_sent(int num_dir) 
{ 

void cut_word_in(char gen_cutl15],char a[15]); 
void cut_word_out(char gen_cut[15),char a[15]); 
int J,k,l; 
char a[15]; 

int out_number,in_number,len,pr,prt ; 
struct STRING out{10]; 
struct STRING in(10]; 

gen_cut.amount=gen. amount; 

g e n_cut .re pr . Ietter= gen .repr . letter; 

gen_cut.repr.num= gen.repr.num; 

j=0; 
k=0; 
pn=0; 
pn=0; 
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while G<num_dir) 
{ if (markjong[fl!=0) 

pn=1; 
continue; 

} 

else break; 

} 

if (pn==1) 

{ in_number=gen.repr.tabl[fl .number; 
for (i=0;i<in_number;i++) 
{ strcpfy(a,gen.repr.tablQJ.row[iJ.str); 

cut_word_in(gen.repr.tabl01.row[i].str t a); 
strcpyOnpJ.str f a); 

} 

gen_cut.repr.tabl[k].number=in_number; 

for O=0;f<in_numbenl ++ ) 

strcpy (gen_cut.repr.tabl[k] . row[Q.str,i n[i] .str) ; 
pr1=0; 

} 

else 

{ gen_cut.repr.tabl[k].number=gen.repr.tabl[j]. number; 
for O s= 0;i<gen_cut.repr.tabl[k] .number;i++) 
strcpy (gen_cut.repr.tabl[k] .row[i] .str.gen .repr.tablQ] .row[t] .str); 



for 0=0; i<gen_cutrepr.tabl[0].number;i++) 
{ if feen_cut.^epr.tabl[0].row[i].strtO]== , _ , ) 
gen_cut .repr.tabl[0] . rowp] .str[0]«^; 
else 

{ If (gen_cut.repr.tabl[0].row[i].str[0]== w ) 
• 

else 

{ strcpy(a,~ ,f ); 

strcat(a ,gen_cut . repr. tabl[0] . row[i] .str) ; 
strcpy(gen_cutrepr.tabl[0].row[Q.str f a); 

} 

} 

> 

k++; 

whileQ<num_dir) 
{ while ((markJongQ] i ==0)&&0 < num_dir)) 

{ gen_cut.repr.tabl[k].number=gen.repr.tablfll.number; 
for (i=0;t<gen_cut.repr.tabl[k] .number;i++) 
strcpy(gen_cut.repr.tab!tkJ.row[i].str,gen.repr.tabl[fl.row[n.str); 

k++; 

} 

pp=1; 

out_number=gen.repr.tabl[j]. number; 
for (i =s 0:»<out_number;i++) 
{ strcpy(a.gen.repr.tabl[D .rowDJ.str); 
cut_word_out(gen .repr.tabl[j] .row[i] .str.a) ; 
strcpy(out[i].str f a); 

} 

while ((markjongffl=1)&&0 < num_dir)) 
if G==num_dir) break; 
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pr=0; 

in_number=gen.repr.tabl[[].number; 
for (i=0;i<in_number;i++) 
{ strcpy(a ( gen.repr.tabl[D-row[i].str); 

cut_wordJn(gen.repr.tabI[D.row[r|.str ( a); 

strcpy(in[i].str,a); 

} 

pasteOc.out^number.oul.in^number.tn); 
k++; 

} 

if (pr==1) 

{ gen_cut.repr.tablIkJ.numbep=out_number; 
for (i=0;i<out_number;i++) 
strcpy(gen.cut.repr.tabl[k].row[0.str,out[a.str); 

} . 
else 

{ gen_cut.repr.tab![k].number*gen.repr.tabl[D.number; 
for 0=O;i < gen_cut.repr.tabl[k].number;i-»-+) 
strcpy(gen_cut.repr.tabl[k].row[ii.str I gen.repr.tabl[D.rowp].str); 

k++; 

for (i=0; i<gen_cut.repr.tabl[k-1].number;i++) 
{ len=strlen(gen_cut.repr.tabI[k-1].row[il.str); 
if (gen_cut.repr.tabI[k-1].row[i].str[len-1]== , _ # ) 

* * 
eise 

{ strcpy (a,gen_cut . reprtabi[k-1 ] .row[Q .str) ; 
strcat(a ."_"); 

strcpy(gen_cut.repr.tab![k-1].row[i].str,a); 
strcpy(a,gen_cut.repr.tabI[k-1].row[iJ.str); 

} 

} 

void cut_skel(int num_dir,int k) 

int ]; 
int I; 

float min_x,min_y; 

for (j=0;j<6J++) 
mark_long[j|eO; 



for Q=0;j<num_dir-k;j++) 
markjonglart_num_long[fl]=1 ; 

NO; 

for (j=0 j<num_dir;j++) 
{ if (mark_long[D==0) 
{ cut_x_midll[IJ.x_b=x_midllID.x_b; 

cut_x,midll[0.x_e=x_midllU] .x_e; 

cut_y_mid!l[IJ.y_b=y_midllDl y J>; 

cut_y_mtdll[!] .y_e=y_midllQ] yle; 

cut_x_dev[f].x_b=x_dev[D .x_b; 

cut_x_dev[l].x_e=x_dev[j] x_e ; 

cut_y_dev[l].y_b=y_dev[j) .y_b; 

cut_y_dev[Q.y_e=y__dev[j] .y_e; 
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»++; 

} 

} 

min_x=9999.0; 
min_y=9999.0; 
for 0=O;j<=JJ++) 
{ if (min_x > cut_x_mid!IB].x_b) 

mi n_x-cut_x_midl![fl.x_b; 
if (min_x > cut_x_midll[fl.x_e) 

min_x«cut_x_midll[fl.x_o; 
if (min_y > cut_y_midH|jJ.y_b) 

min_y=cut_y_mid!IQ].y_b; 
if (min_y > cut__y_midll[fl.y_e) 
^ min_y=cut_y w midIllD.y_e; 

for (j=OJ<l;j++) 

{ cut_x_midll[B.x_b=cut_x_midil[D.x_b-min_x; 
cut_x_midll[D.x - _e=cut_x_midllDl.x e-min_x; 
cut^midH[D7_b=wjt_y_midll[D.yIb-min - _y; 
cut_y_midlIO].y_e=cut_y_midI[0].y_e-min_y; 

} 

void sav_new(int num_dir,int k,FILE *fp1) 
int ij; 

fprintf(fp1 ,"%c ",gen_cut.repr.letter); 
fprintf(fp1 ,"%f " t coef[num_dir-k-1]); 

fprintf(fp1 r%d %c %d • , ,gen_cut.amount 1 gen_cut.repr.letter,gen_cul.repr.num); 
for (MO;i<=k;i++) 

{ fprintf(fp1,"%d ",gen_cut.repr.tab!p].number); 
if (gen_cut.repr.tabl[i].number>0) 
{ for 0=OJ<gen_cut.repr.tabl[i].number ( i++) 

fprintf(fp1 , w %s ",gen_cut.repr.tabip].row[D.str); 
fprintf(fp1,"\rr); 

} 

} 

for O e 0;i<:k;i++) 

fprintf(fp1,"%.4f %.4f ^cuOc_midll[i] jc_b*_midll[i].x_e); 
for (i=0;i<k;i++) 

fprintf(fp1, w %.4f %.4f • , ,cut_x_dev[i].x_b t x„devli]j<_e); 
for (i=0;i<k;i++) 

fprintf(fpV%.4f %.4f -.cut^y^midHH.y^.y^midllH.y^e); 
for (i=0;t<k;i++) 
fprintf(fpl,"%.4f %.4f \n",cut_y_dev[i].y_b,y_dev[i].y.e); 



int cmpr_out(char c) 

{ if (<c=='E')||(c==T')||(c«X)||^ 

(c«*Y"» 

return(1); 
Ise r turn(O); 

} 

int cmprjn(char c) 

{if ((c^^'C^ikc^'D^ii^^'Q^IKc^^ikc^U^ii^T)!!^^)!! 
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10 



15 



20 



25 



30 



35 



40 



45 



50 



return(1); 
else return (0); 

) 

void cut_word_out(char gen_cut[15J,char a[15J) 
{ 

int i; 
int ten; 

ien=strlen(gen_cut); 
i=!en-1 ; 

while (cmpr_out(gen_cut[i])==1) 

{*-; 

if (i<0) break; 

} 

if (i<0) strcpy(a.V); 
else 

{ stmcpy(a,gen_cuU+1); 
} 



void cut__wordjn(char gen_cut[15],char a[15J) 
{ 

int i; 
int ten; 

len=strlen(gen_cut); 

i=0; 

while (cmpMn(gen_cut[i])==1 ) 
if (i>len-1) break; 

} 

if (i>len-1) strcpy(a,"„ n ); 
else 

{ strcpy(ar w ); 
strncpy(a ,gen_cut-H , len-i) ; 
apen-flBW; 

} 

} 

void add_1 (int num_dir) 
{ char letter; 
int i j; 

while (fscanf{fp*%c w f &letter)!=EOF) Hetter from gen set*/ 
{ 

fprintf(fpV%c ".letter); 
fprintf(fpV%f -.1.0); 

fscanf(fp, M %d %c %d ".&g en. amount.&gen.repr. letter ,&gen.repr.num); 
fprintf(fp1 %d %c %d ".gen.amount.gen.repr.letter.gen.repr.num); 
for (i=0;i<«num_dir,i++) 
{ fscanf(fp,"%d *\&gen.repr.tab1[i]. number); 
fprintf(fp1 ,"%d \gen.repr.tablp}.number); 

for (j=Oy<gen.repr.tabl[i].numberj++) 
{ fscanf(fp/%s ",g n.repr.tabl[i].row[fl.str); 
fprintf(fp1 ,"%s ".gen.repntablfQ.rowIfl .str); 

} 

fscanf(fp,nn"); 
fprintf(fp1 ,"\n-); 
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for (ieO;i<num_dir;H-+) 

{ fscanf(fp,-%f %f " t &x_midH[i].x_b,&x midll[fl.x_e); 
fprintf(fp1 ,-%f %f \x_midn[il.x_b ( xZrnidII[iljc_e); 

} 

for O=0;i < num_dir;i++) 

{ fscanf(fp t w %f %f " ( &x_dev{a.x_b,&x_dev[ij xja): 
fprintf(fp1, w %f %f ^x_dev[g*_b t x_dev[0-x_e); 

} 

for O=0;i<num_dir;i++) 

{ fscanf(fp,*%f %f -,&y_midll[Q y_b t &y_midll[iJ.y_e); 
fprintf(fp1 ,"%f %f ",y_mldll[ij .y_b,y_midli[i].y_e); 

} 

for 0=O;i<num_dir;t + +) 

{ fecanf(fp,"%f %f \n^&y_devro.yj3,&y_devffl.y_e); 
fprintf(fp1 ,"%f %f Vn^.y^devH.y^b.y^devpJ.y^e); 

} 
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IV. Recognition procedures 

int main(void) 
{ 

FILE *fp; 
char infile[30]; 
int num; 

struct ffblk ffblk; 
int done; 
int SeqNo; 
read_mapO; 

fp=fopen( , fextr.out ,, f N wb M ); 
fclose(fp); 

fp=fopenCfeatouf , , H wb w ); 
fclose(fp); 

fp=fopenCfeati .outVwb"); 
fclose(fp); 

fp^fopenCrsenLout^b"); 
fclose(fp); 

done=findfirstp.tab",&ffblk t O); 
num=1 ; 
while (Idone) 
{ 

sprintf(infile,"%-12.12s",ffblk.fLname); 

fp=fopen(infile,* , rtf); 

if (!fp) 

{ printff Cant open input file -%s-\n" ( infile); 
return; 

} 

if (infilefOJ N'B 1 ) 
{ letter=tolower(infileIO]); 
SeqNo=(int)(infile[2]-48); 

} 

else 

{ if (isdigit( Ont) infile[1] ) h=0) 
{ letter=tolower0nfile[O]); 
SeqNo=(int)(infile[2]-48); 

} 

else 

{ lettep=infile[1]; 
SeqNo=(int)(infile[3]-48); 

} 

} 

num=transform(fp,&letter); 

if ((num>=0)&&(num<7)) saveJjles(SeqNo,num,&letter); 

if (num==-3) num=1; 

fclose(fp); 

done=findnext(&ffblk) ; 

} 

return 0; 
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r . . MAIN FOR RECOGNITION */ 

v id recogn(FILE *fp t FILE *fp2); 

int main(void) 
{ 

FILE *fp,*fp2; 
int i; 

char filenamel30] .filename 1 [30]; 

map_char[i][1]=0; 

map_charp][0]=*a'; 

tp2=fopen^softoll^, w wb #, ); 

fp^fopenfrsenLoutVrtT); 

recogn(fp,fp2); 

fclose(ft)); 

fclose(fp2); 

return 0; 

} 

/ 

structures initialization (in itial set of the symbols to be recognized) 

void read_rnap(void) 
{ 

FILE -fp; 
int i; 

fp=fopenCmap_chVrb w ); 

for (i=0; i<NUM_SYMBOLS;i++) 

fscanfffp.^/od %d\n ,, i &map„charlil[0],&map_char[ill1]); 
fclose(fp); 

} 

r 

funrt on defines if the char letter was in mapping card in training set 

x± , J f 

int check_map (char letter) 
int i; 

for (i=0;i<NUM_SYMBOLS;i++) 

if (Oetter==(char)map_char[l][OJ)&&(map_charmri]>0)) retum(0; 
if (i==NUM_SYMBOLS) 
{ printfCThere is no such character in the map\n"); 
return(-1); 

} 

return(-1); 

} 

r « 

function reads FILE *fp (symbols to be recognized ) and using generalized 
information after the training (FILE *fp1) defines similarity functions 
for every symbol to be recognized from the different points of view and 
writes t his information to FILE *fp2 

, — - — .i-i ~*/ 

int con v (void); 

float def_k_sent(int num_dir); 

float metric_dir_y(int num_dir,int amp_y,struct X xO.struct Y y[J); 

float metrtc_dirjc(tnt num_dir,int amp_y,struct X xQ.struct Y yQ); 

void lengthflnt nurn_dir); 

float cut_skel(int num_dir,int k); 

void cut__s nt(int num_dir); 
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int calc_pen_up(char a[MAXJ-ENGTH_SENTENSEJ); 
void recogn(FILE *fp,FILE *fp2) 
{FILE *fp1; 

char filename 1 [30]; 

float w_sent ; w_y,w_x; 

int amp_y,w_pen_up; 

char ch ( letter; 

int letterjnum; 

int i j,k; 

int num_dir; 

char nurnJongllO); 

float gen_coef,rsent_coef; 

int gen_max_pen_up,gen_min_pen_up; 

int rsent_pen_up; 

char our_sent1[MAX_LENGTH_SENTENSE]; 

while (fscanf(fp ( H %d w ,&ietter_num)!=EOF) 
{ 

fscanf(fp; %c \&ch); 
fscanf(fp,"%d ".&num_dir); 
if (num_dir==0) continue; 

fecanftfp^/os \our_sent); /"letter from recognition ser/ 
for (i=0;i<num_dir;i++) 
fscanf(fpr%f %f " 1 &xOJ.x_b,&xp].x_e); 
for (i=0;i<num_dir;i++) 
fscanf(fp,"%f %f ",&y[I].y_b.&y[i].y_e); 
fscanf (fpr%dVn",&amp_y) ; 
for (i=0;t<num_dir;i++) 
xz[i]=x[i]; 

for (i=0;i<num_dir;r++) 

yzDJ^yB; 

strcpy(our_sent1 ,our_sent); 
if (convO— 0) 
{ printfCThis ligature is too long\n"); 
continue; 

} 

for (i=0;i<=num_dir; i++) 

strcpy(bufzp],buf[ij); 
rsent_pen__up==calc_pen_up(our_sent1); 
{ 

k=num_dir; 

rsent_coef=1.0; 

length(num_dir); 

for (num_dir«lc; num_dir>=1 ; num_dir— ) 
{strcpy (filename 1 ,"gL_cut"); 
sprintf(numJong > **%d B ,num - .dir); 
strncat(filename1 r nurn_long,1); 
strcat(fiiename1 .".out"); 
fp1=fopen(fiiename1 ,"rfo"); 

while (fsranf(fp1 l ^X>c*\&ietter)i=EOF) rietter from gen setV 
{ 

fecanf(fp1 ,"%f *\&gen_coef); 

fscanf(fp1 %d %c %d M .&gen.amount t &gen.repr.letter t &gen.repr.num); 
for (i=0;i<=num_dir;i++) 
{ fscanf(fp1 ,"%d ,, t &gen.repr.tabl[i]. number); 
for (j=0*j<gen.repr.tabi[i].numberj++) 
fscanf(fp1 ,"%s ".gen.repr.tablpj.rowflj.str); 
fscanf(fp1,"\n~); 
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} 

fscanf(fp1 "%d %d\n",&gen_max_pen_up,&gen_min_pen_up); 

for (i=0;i<num_dir;i-»-+) 

fscanf(fp1 ,"%f %f -,&x_midll[il.x_b,&x_midn[ij jc.e); 
for fi=0;i<nurn_dir;H-+) 

fscanf(fp1 ,"%f %f *,&x_dev[i].x_b,&x_dev[I].x_e); 
for fi=0;i<num_dir;i++) 

fscanf(fp1 ,"%f %f ",&y_midll[Q.y_b t &y_midll[iI.y_e); 
for {i s =0;i<num_dir;i++) 

f5canf(fp1,-%f %f \^&y_devfl.y_b,&y_devH.y_e); 
w_sent=gen_coerrsent_coerdef_k_sent(num_dir-1) ; 
wj=gen_coerrsent_coermetric_dir_y(num_dir,amp_y t x ( y); 
w - x=gen_coerrsent_coermBtric^dir_x(nuni_dir,amp_y,x t y); 
if ((rsent_j>en_up >= gen_min_pen_up)&& 

(rsent_pen_up <= gen_rnax_pen_up)) w_pen_up=1; 
else w_pen_up=0; 
if (rsent_coef>TRESH_CUT) 

fprintf(fp2,"%c%d %d %c %f %f %f %d\n\ 

ch l letter_num l num_drr,letter ) w - sent t w_y t w_x ) w _pen_up); 

} 

fclose(fp1); 

if (num_dir==1); 

else 

{ rsent_coef=cut_skel(k,nunv_ dir-1); 
cut sent(k); 

} 

} 

fprintf(fp2,"~ ); 

} 

} 

} 

void length(int num_dir) 
{ 

int i j; 

float arr_hip[6]; 
char letter; 
int pr; 

float temp_fl; 
int temp; 

for (i=0;i<num_dir;i++) 
arr_hip[i}=fabs(y[Q.y_e-y[i] .y_b); 
for 0BO;i<num a _dir;H H *O 
ar^num^longp] 83 !; 
pp=1 ; 

while (pr==1) 
{ pr=0; 

for (i=num_dir-1;i>=1;i— ) 
{ if (arr_hip[i] < arr_hip[i-1]) 
{ temp_fl=arr_hip[i-1 ] ; 
arr_hip[i-1 ]=arr_hip[i] ; 
arr_hip[i] = temp_fl; 
temp==arr_numJong[i-1]; 
arr_num_longn-1]=arr_numJong[i]; 
arrnum_l ng[i]=temp; 
pr=1; 

} 
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} 

} 

coef[0]=1.0; 
for Ci=1;i«num_dir;i++) 
coefO]=coef[i-1J"(1 .0-arr_hip[M]); 

> 

void paste(int k.char out[10],char in[10]) 
{ int i j.mjen^out; 
char a[20]; 
strcpy(ar"); 
len_put=strlen (out) ; 
if (out[len_out-1]«in[0]> 
.{if (len_out>1) 

{ strncpy(a.outjen_out-1); 
a[len_out-1]=A0 i ; 

} 

else 

strcpy(a,""); 

} 

else 

strcpy(a,out); 
strcat(a ( in); 
if (strlen(a) < 10) 
strcpy(buflk] t a); 
else 

{ printfCRSENT.OUT - ERR. paste, length of pasted word 
getchO; 

} 



void cut_sent(int num_dir) 
{ 

void cut_word_jn(char gen_cut[15],char a[15]); 
void cut_word_out(char gen_cut[15],char a[15]); 
int j,k,i; ' 
char a[15]; 

int ou^numberjn^umber.len.pr.prl; 
char out[10]; 
char in[10]; 

for O =: 0;i<=num_dir; 

strcpy(buffl],~*); 
j=0; 
k=0; 
pr=0; 
pr1*0; 

while (j<num__dir) 
{ if (markJongQ]!=0) 

pr1=1; 
continue; 

} 

else break; 

} 

if (pr1==1) 
{ strcpy(a,bufe[fl); 
cut_word jn(bufz[j] ,a) ; 
strcpy(buf[k],a); 
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pr1=0; 

} 

. else 

strcpy(buf[k],bufz[fl); 

if (buf[OI[0]=='J) 
bufIO][0]=~; 

else 

{ if (buf[0][0]«") 
else. 

{ strcpy(a,-~); 
strcat(a,buf[0]); 

} 

} 

k++; 

whileO<num_dir) 

{ while ((markJong[fl=«0)&&G<num_dir)) 
{ strcpy(buf[k].bufz[fl); 

k++; 

} 

pr=1; 

strcpy(a,biifz[fl); 
cut_word_out(bufz[fl t a) ; 
strcpy(out,a); 

while ((markjong[n"1)&&0<num_dir)) 

if (j==num_dir) break; 

pr=0; 

strcpy(a,bufz[j]); 
cut_w6rd_in(bufzlfl 
strcpyOn^); 
paste(k.out.in); 

k++; 

} 

if (pr==1) 

strcpy(buf[k],out); 
else 

strcpy(buf[k],bufeUl); 

len=strlen (buf[k-1 ]) ; 
if <buf[k-1][len-1]=='_'); 
else 

{ strcpy(a,buflk-1]); 
strcat(a.V); 
strcpy(buf[k-1],a); 
strcpy(a,buf[k-1]); 

} 



float cut_skel(int num_dir,int k) 
{ 

int j; 
int I; 

float min_x f min_y; 
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for (f=0;j<6;j++) 
markjong[j]=0; 

for 0=O;j<num_dir-lc;j-M-) 
markJong[air_numJong[fl]=1 ; 

1=0; 

for O=0;j<kj++) 
{ if (mark_long[j]=«0) 
{x[Q.x_b=x2tD.x_b; 

y[l].yj>=yz[j].y_b; 
y[0.y_e=yz[fl.y_e; 
H-+; 

} 

} 

min_xe9999.0; 
min_y=9999.0; 
for (j=0;j<=l;j++) 
{ if (min_x > x[fl.x_b) 



min_x=xQ].x_b 
min_x=x[j]jc_e 
min_y=y[j].y_b 
min_y=y[j].y_e 



if (min_x > x[j].x_e) 
if (min_y > y[fl.y_b) 
if (min_y > y[fl.y_e) 

} 

for (j=0;j<l*j++) 
{ x|j].xj3=x[fl.xj>mm_x; 

x[D J<_e=x[fl.x_e-min_x ; 

yd .y_b=y [j] .y J>-min_y ; 

yffl y_e=y DJ.y_e-minjy; 

> 

return(coef[num dir-k]); 

} 

int cmp_out(char c) 
{ rf (<c«-E0||<c^=T^||<c==XW 



return(1); 
else return(O); 

} 

int cmp_in(char c) 
{ if <<c~X;')||(c«=Tr)||(c«^^^ 



<c=='V)) 



return(1); 
etee return(O); 

} 

void cut_word_out(char gen_cut[15].char at15]> 
{ 

int i; 
int len; 

len=strten(gen_cut); 
i=len-1 ; 

while (cmp_out(gen_cut[i])==1) 
{ i— ; 
if (i<0) break; 

} 
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if (\<0) strcpy(a,V); 
else 

{ stmcpy(a,gen_cutj+1); 
} 

} 

void cut_wordjn(char gen_cut[15] t char a[15]) 
{ 

int i; 
int len; 

len=strlen(gen_cut); 
i=0; 

while (cmpjn(gen_cut[i])==1 ) 
{ 

if (i>len-1) break; 

} 

if (Men-1) strcpy(a,-_-); 
else 

20 { strcpy(a,~); 

stmcpy(a,gen_cut+Uen-f); 
apen-q-W; 

} 

} 

25 <nt calc_pen_up(char a[MAX_LENGTH_SENTENSE]) 

{ int count; 
char *p; 
count=0; 

if ((strlen(a)==1)&&(a[0]=« J)) 

return(O); 
p=*strchr(a t 'J); 
if (p==NULL) return(O); 
while(pNNULL) 
{ P=strchr(p+1,'J); 
count-M-; 

} 

count—; 
retum(count); 

} 

40 r* 

function convO makes sentence separation into words using symbol "A* 

as delimiter and writes the results to buffl. 

*V 

int conv(void) 
45 { char*p; 

int count; 
count=0; 

p=strtok(our_sent,"A"); 
if (P) 

{ while(p) 

{ strcpy(buf[count],p); 
if (strlen(buf[count])>9) return(O); 
count++; 

p^strtokCNULL^A''); 

} 

} 

else 
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{ printffThere is no long in th sentenced"); 
getchO: 
return(O); 

} 

return(1); 
} 

float def_k_dass(char a, char b,const char c.const char d, const char q, 

const char d_smafl) 

a - letter from the generalized sentence 
b - letter from the symbols' sentence to be recognized 
c.d.q.d.small - symbols' from the same class segments* vocabulary 
function defines if the letters a and the b belongs to one class 
in the segments' vocabulary or not and defines defJc[Q[fl for them 
. in the weight table def_k[5][5] 

■ / 

{ float 

def_k[5][5]={1.00, 0.50, 1.00, 0.25, 0.00, 
0.50, 1.00, 1.00, 0.25, 0.00, 
1.00, 1.00, 1.00, 0.25, 0.00, 
0.25, 0.25, 0.25, 1.00, 0.00. 

0.00, 0.00, 0.00, 0.00, 0 00}; //posibility to modify the similarity !!!! 
char alfabet[4]; 
int ij; 

alfabet[0]=c; 
alfabet[1]=*d; 
alfabet[2]=q; 
arfabet[3]=d_smalt; 



i=0; 

while (al=arfabet[Q) 

if (i==4) 
break; 

} 

j=0; 

while (b!=atfabet[fl) 

{^ + ; 

if 0==4) 
break; 

} 

return(def_ktOlB); 



function def_kjetter0 calculates similirity between tetters in the 

words according to weights table. 

*V 

float def_kjetter(char aQ.char bQ.int i.int j) 
r 

a - word from the generalized sentence 

b - word from symbols s ntence to be recognized 

i - number of letter in the word a 

j - number of letter in th w rd b 
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{ float temp; 
if (a[i]==blfl) 

return(1.00); 
if ((temp=deLk_class(aDJ f b[j];c , ? 'D , l , Q , ;d , ))!«0) 

if ((temp=def.K - class(a[i] r D[J]/E*/P,*x\T))!=0) 

if ((temp-def^classCapl^btD/G'/H'.'Y'/g^NO) 

if ((temp=def_k_class(a[i] f bU]/r/J\r ( r))!==0) 

if (<a[Q«b[fl)&&(an-» a B a )) 
return(O.O); 



return (temp); 
return(temp); 
retum(temp); 
retum(temp); 
return(I.OO); 



} 

int cmprjn(char c) 

{ if ((c^'EllKc—VOIKc— 

(c==T-)) 

return(l); 
else return(0); 

> 

Int cmpr_out(char c) 

{ if (<c=='C7||(c=='D')||^ 

(c=='Z*)) 

return(1); 
else return(O); 

} 

r* 

function def_k_word() calculates and returns symilirity function (SF) for the 

every word in the row . SF is defined from 0 to 1. If word in the recognized 

symbol is equal to the word in the row then SF is equal to 1; 

if words are not equal.then parts of words are compared.There are three parts 

in the words.Parfl - down input segments,part2 - down output segments, part3 

segments between parti and part2 

*V 

fl oat de f_k._word(char afl t char b[] ? int row) 

words' similarity comparison function 

a - word from the generalized sentence 

b - word from the symbols sentence to be recognized 

{ float w=0.0; 

int i j,n,m t temp.i_end_1 ,i_end_2,i_end_1 ,i_end_2; 
int pr_a_1=0 t pr_a_2=0 f pr_b_1=0,pr_b_2=0; 
float w1 =0.0,w2=0.0,w3=0.0 f w4=0.0; 
if (strcmp(a,b)==0) 

return(1.0); 
n=strlen(a); 
m=strlen(b); 

if ((n==0)&&(m!=0)) retum(O.O); 
if ((n!=0)&&(m==0)) retum(O.O); 
if ((n=-=0)&&(m==0)) return(1.0); 

If (n>=m) temp=n; 

Ise temp=m; 
if (row==0) 
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{ for (i=n-1 J=m-1 ;(i>0)H(j>0);i- j-) 
w=w+def_k_letter(a,bj j) ; 
if (temp>1) w=w/(float)(temp-1); 
else w=1.0; 
return(w); 

} 

else 
{ if (row==2) 
{ for Cf=0; (i<n-1)||0<m-1); 

w=*w+def_kjetter(a ,b,i , i) ; 
if (temp>1) w=w/(float)(temp-1); 
else w=1.0; 
return(w); 

} 

else 
{i=0; 

while (cmpr_out(a[i])==1) 

P'_a_1=1; 
if (i>n) break; 

} 

Lend_1=i-1; 
i=n-1; 

while (cmprjn(a[i])==1) 

{ >-; 

pr_a_2=1; 
if (i<0) break; 

} 

i_end_2=i+1 ; 
i=0; 

while (cmpr_out(b[t])— 1) 

pr_b_1=1; 
If (i>m) break; 

} 

j_end_1=i-1; 
i=m-1; 

while (cmprjn(b[i])-=1) 

{«-: 

pr_b_2=1 ; 
if (i<0) break; 

} 

jLend_2=i+1; 

if ((i_end_J >=i_end_2)| |Q_end_1 >=jLend_2» 

{ putsflt's not right dividing inside the words\n"); 
printfCaD=%s bQ"%s\n M ,a v b); 

printfO_end_1=%d i_end_2=%d L©nd_1=%d i_end_2=%d\n m t 

Lend_1 ,i_end_2 JLendjI jLend_2); 
printfCpr_a_1=%d pr_a_2=%d pr_b_1=%d pr_b_2=%d\n", 
pr_a_1 .pr_a_2 ( pr_bj ,prj>_2); 

getchO; 

getchO; 

} 

if ((pr.a,1= :s =1)&&(pr_b - 1==1)) 
for (i=Oj=O;(i<=Lend_1)||0<=Lend_1);iH»fj-M-) 
wl=w1+def_kjetter(a,b.ij); 

if <(pr_a_2"1)&&(pr_b_2"1)) 
for (i=n-1 j=m-1 ;(i>=Lend_2)||G>=Lend_2);i- j-) 
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w2=w2+def_kjetter(a,b,i,j); 
if (0_end_2!=i_end_1 +1 )&&<Lend_2!=jLend_1 +1)) 
{ for 0=Lendj+1 j=jLe«d_1+1;0<Lend_2)||(j<Lend_2);i++ 
w3=w3+def_kjetter(a,b,ij); "~ 
for (m_end_2r\ j«Lend_2-1;Ci>Lend_1)||(j>Lend_1);i--j-) 

w4=w4+defjcjetter(a t b,ij); 
if (w3<w4) w3=w4; 

} 

if (temp>0) w=(w1+w2+w3)/(float)(temp); 
else 

{ printf(~def_k_word~ -amount of tetters in the row equal 0\rT); 
getchO; 

} 

} 

} 

return(w); 

} 

function def_k_row() calculates and returns symitirtty function for every 
row in symbols generalized representation as maximum value in row. 
SF is defined from 0 to 1 . 
•V 

float def_kjow(int num_dir,int count.int row) 
{ float temp; 

float w=0.0; 

intj; 

if (gen.repr.tabl[countJ.number<1) 

If (bufIcount]«=NULL) retum(1 .0); 

else retum(O.O); 
for 0=0; j<gen.repr.tabl[count]. number; j++) 

if ((temp=def_k_word(gen.repr.tablIcount].row[fl.str, 

buf[count],row)) > 0.9999999) 

{ w=temp; 
break: 

} 

else 
if (temp>w) 

w=temp; 

retum(w); 

} 

float def_k_sent(int num_dir) 
{ float w=0.0; 
int count; 

w=w+def_k_row(num_dir,O,0); 
if (num_dir>0) 

{ for (count=1; count<num_dir+1 ; count++) 
{ w=w+def_k_row(num_dir,count,1); 
} 

} 

w=w+def Jc_row(num_dir,num_dir+1 ,2); 
return(w/(float)(num_dir+2)); 

} 
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r* — 

similarity function defining similarity between defined param and 
sample of parameters with known medial, left and right d viation, 
and range of definition (constJ t const_r) 

m - / 

float mut_metric(float param.float medial.float const_l,float const_r, 

float dev_J,float dev_r) 

{ float lett.right.m.div; 
left=medial-dev_l; 
if (left<constJ) left=const_l; 
right«medial+dev_r; 
if (right>const_r) right=const_r; 
if ((param >- left)&&(param <=right)) 

return(1.0); 

else 

{ div»const_r-const_l-right+left+0.0001 ; 
if (drv==0.O) 
{ if (medial==0) 

{ printf ("ERROR in mut_metric\n"); 
getchO; 

} 

div-medial; 

} 

if (param < left) 

m=1.0 - (left-param)/div; 
if (param > right) 

m=l .0 -(param-right)/div; 

} 

if (m<0.0) m=0.O; 
return (m); 

} 

/~~*~~ ~~~~ ■ 

functions metric_dir_yO and metric_dir_xO calculate similarity 
metrics on the base of distance between recognized letter skeleton 
an d symbofs gene ralized skeleton calculated during a teaching. 

*~ J / 

float metric_dir_y(irrt num_dlr,int amp_y .struct X xfl.struct Y yQ) 
{ int count; 
float rrM ,m_2 f metric; 

metric=1.0; 

for (count=0;count<num_dir;count++) 
{ m^l^mut^metrictylcountj.y^b.y^midllfcountl.y^b.O.O.1 .0, 

y_dev[count].y_b,y_dev[count] y_»; 

m_2= mut - metric(y[count].y_e l y_midll[countj.y_e t 0.0 i 1 .0, 

y_dev[count] y_e ,y_dev [count] .y_e); 

metric=metric*m_1 *m_2; 

} 

retum(metric); 

} 

float metric_dir_x(int num_dir,int amp_y,struct X xQ .struct Y yQ) 
{ int count; 

float m_J ,m_2.metric; 

metric=l.O; 
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f r (c unt=0;count<num_dir;count++) 
{ m_1 =mut_metric(x[count].x_b,x_mid!I[count].x_b f 0.0 f 1 .0, 

• x_devIcountl.x_b.x_devlcountl.x_b); 

m_2=mut_metric(x[count].x_€ 1 x_midll[courTt].x_e f O.O l 1 .0, 

x_dev[countJ.x_e f x_dev[count].x_e); 

metric=metric*m_1 *m_2; 

} 

return(metric); 

} 



r * * • 

The file sort.out is sorting step by step using appropriate similarity 
functions (defined with parameters a,b,c and tresholds wjevel.yjevel, 
xjevef) and their order.the result is written the file err. 

' / 

int main(void) 
{ 

char sort(int j.char a, char b.char c.float wjevel.float y_ievel, 

float x_level,char ch.int num_dir); 

int check_map (char letter); 
void read_map(votd); 
void r_matr(void); 

int ij; 

float w^evei.yjevel^level; 
char a,b,c; 

char ch,temp_ch Jotter; 

int letter_num,num_dir; 

float ttt; 

int tt; 

a=W; 

b=V; 

c=' '; 

w_Jevel=0.6; 
y_level=0.6; 
x_ievel=0.6; 

touts = fopen f err",^**); 

fprintf(fout5,"%c%c%c Mw=%.4f My=%;4f Mx=%.4f\n",a,b,c,wjevel t 

yjevel,x_level); 

fp=fopen("sort.outVitr); 
while (fscanf(fp,"%c ,, .&ch)!=EOF) 
{ i«0; 

fscanf(fp,"%d %cT,&ietter_num,&num_dir); 

fprintf(fout5,"%d %c numJong=%d",letter_num i ch,num_dir); 

fscanf(fp," %c \&arr_srt[i]. letter); 

fscanf(fp,"%f " ? &ttt); 

arr_srt[i].w=ttt; 

fscanf(fp.-%f ",&«); 

arr_srt[i].y=ttt; 

fscanf(fp,"%f ",&ttt); 

arr_srt[0.x=ttt; 

fscanf(fp."%d\n" t &tt); 

arr_srtp].pen_up=tt; 

temp_ch=ch; 
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fscanfffp.^cT.&ch); 
while (ch!=~) 

fscanf(fp,"%d %cT I &letter_num 1 &num_dir); 

fscanf(fp," %c %f %f %f %d\n" l &arr_srt[Q.letter I &arr_srt[il.w ( 

&arr_srt[Oy,&aiT_srtni.x,&arr_srtIil.pen_up); 
fscanf(fp ( "%c",&ch); 

} 

letter=sortO ) a,b 1 c 1 w_level I yJevel,xJeveI,terTp - ch ) num - jdir); 

} 

fclose(fp); 
fctose(fout5); 
return 0; 

} 

int sort_a(int j,char a.float wjevel.float yjevel.float xjevel) 

int sort_w(int j.float level); 

int sort_y(int j.float level); 

int sortjc(int j.float level); 

if (a— V) retum(sort_w(j,wJevel)); 

if (a==y) return(sort_y(j f yJevel)); 

if (a~Y) retum(sort_jc(j,xJevel)); 

return 0); 

} 

int sort_b(int j,char b.float wjevel.float yjevel.float xjevel) 
{ 

int sort_w(int j.float level); 

int sort_y(int j.float level); 

int sort_x(int j.float level); 

if (b==V) retum(sort_w(j,wJevel)); 

if (b*»y) return(sort_yG.yJevel)); 

if (b=V) retum(sort_xG,x_level)); 

returnO); 

) 

int sort_c(int j.char c.fioat wjevel.float yjevel.float x JeveO 

int sort_w(int j,float level); 

int sort_y(int j.float level); 

int sortjc(int j.float level); 

if (c==*W) retum(sort_w(j f wJeveI)); 

if (c== y ) return(sort_y(j,y level)); 

if (c==V) retum(sort_x(j,xJevel)); 

return(j); 

} 

char sort(int j.char a.char b.char c.float wjevel.float yjevel. 

^ float xjevel.char ch,int num_dir) 

int i.k.l; 

i=sort_a(j,a,wJevel,yJevel f x_level); 
if <N=0) 

{ //if (ch!=arr_srt[0] letter) 
fprintf(fout5, w %d\n%c Mw=%.4f My=%.4f Mx=%.4f Mup=%d\n\ 
1, 

arr_srt[0].letter. 

arr_srt[0].w, 

arT_srt[0].y, 

arr_srt[0].x, 

arr_srt[0).pen_up); 
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return (arr_srt[OJ. letter); 

} 

k=sort_b(i ( b,wJevel,yJevei,xJevel); 
if (k==0) 

{ //if (ch!=arT_srt[OJ.Ietter) 
fprintf(fout5,- %d\n%c Mw»%.4f My~%.4f Mx»%.4f Mup»%d\n w , 
1, 

arr_srt[0]. letter, 
arr_srt[0].w, 
aiT_srt[0].y, 
arr_srt[0].x, 
' arr_srt[0].pen_up); 
return (arr_srt[0] .letter); 

} 

l=sort_c(k,c,wJevel,yJeveUJevel); 
If (l<0) 

{ printfCKOVn"); 
getchO; 

} 

If (l==0) 

{ //if (chNarr_srt[0].letter) 
fprintf(fout5, N %d\n%c Mw*=%.4f My=%.4f Mx«%.4f Mup=%d\n", 
1, 

arr_srtfO].letter, 
arr_srt[0].w f 
arr_srt[0].y, 
arr_srt[0].x, 
arr_srt[0] . pen_up) ; 

return <aiT_srt[0]. letter); 

} 

else 

{ //fprintf(fout4r%d long %c f.num^dir.ch); 
fprintf(fout5r %d\n H t l+1); 
for (i=0;i<=I;H*+) 

{ //f prtntf(f out4 ,"%c", arr_srt[l] . letter) ; 

fprintf(fout5 f "%c Mw»%.4f My«%.4f Mx=%.4f Mup-^fccftn", 
arr_srt[ij. letter, 
arr_srtpl.w f 
arr^srtpj.y, 
arr_srt[i].x, 
arr_srt[i].pen_up); 

} 

} 

return (arr_srt[0]. letter); 

} 

int sort_w(tnt j,float level) 
{int i; 
char ch; 

float temp_1 ,temp_2 t tempjv 1 temp_y,temp_x,temp_pen_up; 
int pr=1 ; 

if (j=~0) return(O); 
while (pr==1) 
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{ pr=0; 
for (i=j;j>0;i-) 
{ temp_1 =arT_srt[i].w; 
temp_2=arr_srtp-1].w; 
if (tempjl > temp_2) 
{ ch=arr_srtp-1].letter; 

temp_w=arr_srt[i-1 ] .w; 

temp_y=an_srtp-1].y; 

temp_x=arr_srtp-1J.x; 

temp_pen_up=arr_srtp-1].pen_up; 

an_srtp-l] . ietter=arr_srt[Q .letter; 

arr_srtrM].w=arr_srt[i].w; 

aiT_srt[i-l].y=aiT_srt(ij.y; 

arr_srt[i-1].x=arr - srt[i].x; 

aiT.srtp-1J.pen_up=arr_srtO].pen_up; 

arr_srt[M j . m~temp_1 ; 

arr_srtp].letter»ch; 

arr_srt[i].w=temp_w; 

arr_srtp].y=temp_y; 

arr_srtp] .x«temp_x ; 

an_srt[i].pen_up=temp_penjjp; 

arr_srt[i].m=temp_2; 

pr=1; 

} 

else 

{ arr_srtp-1].m=temp_2; 
arr__srt[i].m=temp_1; 

} 

} 

} 

level=arr_srt[0] w-level; 
if (level<=0.0) leveN=0.0; 
i=0; 

while (0<=j)&&(arr_srt[i].w >= level)) 

if Q~0) return (0); 
else return(i-1); 

} 

int sort_y(int j.float level) 
{ int i; 
char ch; 

float temp_1 t temp_2 l temp_w 1 temp_y,temp__x,temp_pen_up; 
int pr=1; 

if (j==0) return(O); 

while (pr«==1) 
{ pr=0; 
for (i=j;i>0;i-) 
{ temp_1 «arr_srt[ij .y ; 
temp_2=arr_srtp-1].y; 
if (temp_1 > temp_2) 
{ ch=arr_srt|i-1].letter; 
temp_w=arr_srtp-1 ] .w; 
temp_y=arr_srt[i-1 J .y ; 
temp_x=arr_srtfl-1].x; 
t mp_pen_up=arr_srt[i-1] t pen_up; 
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arr_srt[i-1].letter=arr_srt[Q.letter; 

au_srt[M].w=arr_srt[i].w; 

an_srt[i-1 ] .y=arr_srt[I] .y; 

arr_srt[i-1 ].x=arr_srt[il .x; 

arr_srt[i-1 j . pen_up=arr_srt[i] .pen_up; 

aiT_srt[i-1].m=temp_1 ; 

arr_srtp].letter=ch; 

an_srt[i] .w=temp_w; 

arr_srt[i].y=temp_y; 

a rr_srtpj .x =temp_jc ; 

arr_srt[ij . pe n_u p=te m p_pen_u p ; 

arr_srtp].m=temp_2; 

pr=1; 

} 

else 

{ arr_srtp-1].m«temp_2; 
arr_srt[i] .m=temp_1 ; 

} 

} 

} 

leveNarr_srt[0] y-level; 
if (level<=0.0) leveNO.O; 
i=0; 

while (0«jO&&(an_srt[i].y >= level)) 
i++; 

if (i«0) return (0); 
else return(M); 

} 

int sort_x(int j.float level) 
{ int i; 
char ch; 

float temp_1 ( temp_2,temp_w,temp_y,temp_x f tempj>eri_up; 
intpr=1; ~ 
if (p=0) retum(O); 
while (pr=*1) 
{pr=0; 
for (i=j;i>0;i-) 
{ temp_1*arr_srt[i].x; 
temp_2«arr_srt[i-1].x; 
if (temp_1 > temp_2) 
{ ch=arr_srt[M].letter; 
temp_w=arr_srt(i-1].w; 
temp_y=arr_srtp-1 J.y; 
temp_x=arr_srt[i-1 j.x; 
temp__pen_up=arr_srt[i-1].pen_up; 
arr_srtp-1 ] .letler=arr_srt[q.letten 
arr_srt[i-1 J . w=arr_srt[0 - w; 
arr_srt[i-1 ] .y-arr_srt[?].y ; 
arr_sit[M].x=arr_srt[i].x; 
arr_srt[i-1].pen_up=an_srt[fl.pen_up; 
arr_srtp-1 ] . m=temp_1 ; 
arr_srt[i]Jetter=ch; 
arr_srt[i] .w=temp_w; 
arr_srt[ij.y=temp_y; 
arr _srt[i}.x=temp_x; 
arr_srt[i] .pen_up=temp_pen_up; 
arr_srt[ij.m=t mp__2; 
pn=1: 
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} 

else 

{ arr_srt[i-1].m=temp_2; 
arr_srtpj,m=temp 1; 

} 

} 

} 

leveNaiT_srt[0] .x-level; 
if (level<=0.0) leveNO.O; 
i=0; 

while (0< e j)&&(arr_srt[i].x >= level)) 

it+; 

If (i==0) return (0); 
else return(M); 

} 

int check_map (char letter) 
{ 

int i; 

for <i=0;i<NUM_SYMBOLS;i++) 
if (letter=*(char)map_charp][0]) return(i); 
if (i==NUM_SYMBOLS) 
{ printff There is no such character in the map %c\nMetter); 
return(-l); 

} 

return(-1); 

} 

void read_map(void) 
{ 

FILE *fp; 
int i; 

fp=fopenCmap_ch7'rtO; 
for (i=0; i<NUM_SYMBOLS;i++) 
fscanf(fp t -%d %d\n t, f &map_char[Q[0] f &map charflj[1]); 
fclose(fp); 

} 

void r_matr(void) 
{ FILE *fout1; 
int i,j; 

foutl « fopen fmatrix.our ,%/"); 
for (i=0;i<69;i++) 

fprintf (foutl %C\map_char[fl[0]); 
fprintf (foutl t "\n"); 
for (i=0;i<69;i++) 
{ for (pO;j<69J++) 

fprintf (foutl." %2d H ( matr[i][0); 

fprintf (foutl ,"\n~); 

} 

fclose(fout1); 
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/ 

The file "err" is sorting using appropriate similarity 
function defined with treshotd level and it's order. 

* *"/ 

int main(void) 
{ 

int check_map (char letter); 
void read_map(void); 

void add_metric(char ch.irtt letter_num,irrt loop); 

int sort_add(int j.float level); 

void read_map(void); 

void r_matr(void); 

char mtr_cl(int i.char ch); 

int spell_ch ( char [10][20J , char I100](20] ) ; 

int letter_num ? num - dir,loop; 

char ch; 

int i,kj,numjnside,pr; 

float level; 

char replyI100][20] ; 

int re pi; 

read_mapO; 

max_minO; 

leveh=0.4; 

fpsfopenferrVO: 

fp1 =fopenf add_err* , n w+ w ); 

numjnside=0; 

pr=0; ■ 
fseek(fp,37,0); 

while (fscanf(fpr%d" t &letter_num)NEOF) 
{ tscanf<fp," %c\&ch); 
fseek(fp,10,1); 

fscanf(fp,*%d %d\n".&num_dir,&loop); 
for (N n ;i<loop;i++) " 
{ fscanf(fp/%c",&arT_srt[i].letter); 
fseek(fp,6,1); 

fscanf(fp,"%r,&an_srtpj.w); 
fseek(fp f 6,1); 

fecanf(fp ( -%r,&arT__srtp].y); 
fseek(fp,6.1); 

fscanf(f p,"%f \&arr_srt[i] .x); 
fseek(fp,6,1); 

tscanf(fp ,"%d\n",&arr_srt[i].pen_up); 
pr=1; 

} 

add_metric(ch i letter_nunnjoop); 

k«sort_add(loop,tevel); 

if (k>=10) k=8; 

fprintf(fpl ,"%c %d long-%d %d\n*\ch, tetter num.num dir,rioopVk+1); 
if (k==0) ~ 
{ //if (ch!=an_srt[0].letter) 

fprintf(fp1 ,"%c w=%.4f y=%.4f x=%.4f x_vec=%.4f y_vec=%.4f amp=%.4f up=%d m=%.4f\n". 

arr_srt[0]Jetter t arr_srt[0].w 1 arT_srt[0].y f arT_srt[O].x, 
an_srt[0].x_vec,afT_srt[O] .y_vec,arr_srt[0].amp, " 
an_sit[0].pen_up,arr_srt[0].m); 

} 

else 

{// fprintf(fout4 1 "%d long %c r,num_dir,ch); 
for (i=0;i<=k;i++) 
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{// fprintf(foLrtV%c- f an_srtO]. tetter); 
5 fprintf(fp1 t "%c w=%.4f y»%.4f x«%.4f x_vec=%.4f y_vec=%.4f amp=%.4f up=%d m=%.4f\n", 

an_srt[i] . Ietter t an_srt[i] .w ( an_srt[i] .y ,arr_srtti] .x, 
air_srt[Q.x_vec t aiT_sitH.y_voc > aiT_srtp].amp t 
arr_srtp].pen_up f arr_srt[0.m); 

} 

} 

10 if ((i=check_map(ch))<0) 

{ printffERRORr); 
continue; 

} 

if ((j=check_map(arr_srtlO].letter))<0) 
{ printfrERRORa*); 
15 continue; 
} 

matrp]QJ++; 
niirn_inside++; 

} 

2o fclose(fp); 

if (pr^O) 

{ fsh=fopen Csh^sp.our.V); 
fprintf(fsh.-— Oy. 
fclose(fsh); 
return 0; 

> 

fclose(fp1); 
r_matr(); 
return 0; 

} 

30 int check_map (char letter) 
{ 

int i; 

for (i=0;i<NUM_SYMBOLS;i++) 
if (letter=(char)map charp][0]) return©; 
if (i~NUM_SYMBOLS) ' 
35 { printffThere is no such character in the map %c\n", letter); 

return(-1); 

} 

return(-1); 

} 

^ void read_map(void) 
{ 

FILE *fp; 
int i; 

fp=fopen( M map_chVrb~); 
for (i=0; i<NUM_SYMBOLS;i++) 
45 fscanf(fp,"%d %d\n" ( &map_char[i][0] ( &map_charli][1]); 

fclose(fp); 

} 

void r matr(void) 
{ FILE -foutl: 
so »nt i j; 

foutl = fopen fmatrix.outVw"); 
for (i=0;i<69;i++) 

fprintf (foutl,- %c".map_charp][0]); 
fprintf (foutl ,"\n n ); 
for (i=0;i<69;i++) 
55 { for (j s =0J<69j++) 
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fprintf (foutV %2cT,matr[ijni); 
fprintf (fout1."\n w ); 

} 

fclose(foutl); 

« } 



20 



function add_metric() for the every letter (according to It's number 
10 and name) searches it's parameters in the files feat out and featl.out 

and calculates corr esponding metrics. 

void add_metric(char ch.int letter_num,int loop) 

1$ void add_metr_feat(int loop); 

void add_metr_feat1(int loop); 
FILE -fp; 
char temp Jetter; 
int temp_Jetter_num; 
fp^openCfeatoutVrtr); 
while (fscanfffp.^/oc^empJetter^EOF) 

{ fecanf(fp," %d %f %f %f %f\n B ( &tempJetteL_num t &y_vec_beg,&y_vec.end t 

&x_v ec_beg , &x_vec_end) ; 
if ((tempjetter==ch)&&(tempjetter_num==letter_num)) 
{ fclose(fp); 

add_metr_f eat(loop) ; 
break; 

} 

} 

fp-fopenffeatl .outYrb"); 
while (fscanf(fp t "%c" t &tempJetter)!=EOF) 
{ fscanf(fpr %d %d^MenpJetter_num,&arnp_y); 
if ((tempjetter==ch)&&(tempjetter_num==letter_num)) 
{ fclose(fp); 

add_metr featl(loop); 
55 break; 



25 



30 



} 



} 



} 



40 functions add_metr_featO calculates similarity function on the base of 

distance between recognized symbol's vector (connecting start point with 
the end point of the symbol) and generalized symbol's vector defined 
during the teaching. 

"" -" "- i-— » / 

45 void add_metr_feat(int loop) 

int ij; 
FILE *fp; 

float m_1 ,m_2,mj,mj; 
50 char temp_letter; 

for (i=0;i<loop;i++) 
{ fp=fopen( H genfeat.outVrb*); 
while(fscanf(fpr%c" ) &t mpJetter)!=EOF) 
{ fecanf(fp," %f %f %f %nn^&x_midll.x_b,&x_midll.x_e, 

55 &y_midlLy_b,&y_midll.y_e); 

for (j=0; j<3; j++) 

{ fscanf(fp."%f %f o/ of %f\n w f &x_dev[fl.x_b f &x_dev[D.x_e ( 
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&y_dev[fl.y_b t &y_dev[j].y e); 

} 

if (arr_srtp).letter==temp_letter) 
{ fclose(fp); 

m_l=mut_metric(x_vec_beg t x_midl!.)(_b f 0.0 ( 1 .0, 

x_jjevgj.x_b.x_devpj.x_bj; 

m_2-mut_metric(x_vec_end t x_midll.x_e t 0.0 l 1 .0, 

x_dev£]jc_e,x_devpj.x_e); 

arr_srt[i].x_vec=m_1 *m_2; 

m_3=rnut_metric(y_vec_beg l y_midll.y_b,0.0, 1 .0, 

y_dev[2] .y_b,y_devp] .y_b) ; 

m_4==mut_metric(y_vec_end,y_midl!.y_e I 0.0,1 .0, 

y_dev[2].y_e,y_devpj.y_e); 

arr__srt[i].y_vec=m_3*m_4; 
break; 

} 

} 

} 

} 

/ ""' ■ ~ 

functions add_metr_feat1 0 calculates similarity function on the base of 
distance between recognized symbols amplitude and symbols generalized 
amplitude ca lculated during the teaching. 

. ... , J1 — ^ / 

void add_metr_feat1(int loop) 
{ 

int ij; 
FILE *fp; 
float m_1 ; 
char temp_letter; 
int y_max,y_min; 

for (h s 0;i<loop;i++) 
{ fp=fopenfgenfet1.outVrb H ); 
whiJe(fscanf(fp 1 -%c w t &tempJetter)!=EOF) 
{ fecanf(fp t - %f %d %d\n\&y_midll.y_b,&y_max,&y_min); 
for (j=0; j<3; 

fscanf(fp,"%f ",&y_devU].y_b); 
fscanf(fp,-\rr); 

if (arr_srtp].letter==tempjetter) 
{ fclose(fp); 

//y_min=2*y_nrtin;//lt , s better to find ruin and max for aO the symbols 
//y_max=2*y_max; 

m_1=mut_metric((float)amp_y,y_midll.y_b,(float)mut_min,(float)mLit_max ( 

y_devpj.y_b,y_devp].y_b); 

arr_srt[i].amp=m_1 ; 
break; 

} 

} 

} . 

} 

void max_min(void) 
{ FILE Tp; 

char temp_letter; 

int y_max; 

int y_mln; 

int j; 
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mut_max=0; 

mirt_min=9999; 

fp=fopen( M genfet1 .outVrb"); 

while(fscanf(fp,^^MempJetter)!=EOF) 

{ fscanf(fp,- %f %d %d^&y_midll.yj3,&y_max.&y_min); 
for (j=0; j<3; j-»-+) 

fecanf(fp ( -%f ",&y_dev[j].y_b); 
fscanf(fp,"\rO; 

if (mut_max < y_max) mut_max=y_max; 
if (mut_min > y_min) mut_min=y_min; 

fclose(fp); 

} 



similarity function defines similarity between parameter and sample of 
parameters with known medial ,left and right deviation ( and range of definition 
(const_l,const_r) 

float mut_metric(float param,float medial.float constj.float constjr, 

float dev_l,float dev_r) 

{ float left,right,m,div; 
left=medial-devj; 
if (lefl<const_D left=constJ; 
right«medial+dev_r; 
if (right>const_r) right=const_r; 
if ((param >= iett)&&(param <=right)) 

return(1.0); 

else 

{ div=const_r-const_l-right+left+0.0001 ; 
if (div— 0.0) div=medial; 
if (param < left) 

m=1.0 - (left-param)/div; 
if (param > right) 

m«1.0 -(param-right)/div; 

} 

if (m<0.0) m=0.0; 
return(m); 

} 



average similarity function definitionjnal sorting using treshold 



extern struct SRT1 arr_srt[600]; 
int sort_add(int j.float level) 
{ int i; 
char ch; 

float temp_1 .temp^^emp^w^emp^y.temp^x.temp^x^vec.temp^y^vec.temp^amp; 
int temp_up; ~~ 
int pr=1; 

for (i=0;i<j;i++) 

arr_srt[i].m=(arr_srttQ-w+arr_srt[i].y+arr_srt{i].x_vec+ 

arr_srtD]y_vec+arr_srtH.amp+(float)arr_srt[i].pen_up)/6.0; 
if (j-1==0) return(O); 
while (pr==1) 
{ pr-0; 
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for (i=j-1 ;i>0;j— ) 
{ temp_1=arr_srt[i].m; 
temp_2=arr_srtp-1].m; 
if (temp_1 > temp_2) 
{ ch=arr_srt[h1].letter; 

temp_w=an_srtp-1].w; 

temp_y=arr_srt(M] .y ; 

temp_x=arr_srtp-1 ] .x ; 

temp_up=arr_srt[M ] . penjjp; 

temp_x_vecs=arr_srtp-1].x_vec; 

temp_y_yec=arr_srt[i-1 ] . y_yec; 

temp_amp=aiT - srtp-1].amp; 

arr_srtp-1 ] .lBtter=arr__srt[i] .letter ; 

arr_srtn-1].w=anr_srt[il.w; 

arr_srt[i-1 ] . y =arr_srt[i] .y ; 

arr_srt[i-1].x=arr_srt[i] .x; 

arr_srt[i-1].pen_up=arr_srt[i].pen_up; 

arr_srt[i-1].x_vec=arr_srt[ij.x_vec; 

arr_srt[i-1].y_vec=arr_srt[i].y__vec; 

arr_srtp-1].arnp=arr_srt[i].amp; 

arr_srtp-1].m=temp_1 ; 

arr_srt[i].letter=ch; 

arr_srt[i] .w=temp_w; 

an_srt[T| .y=temp_y; 

arr_srt[i] ,x=temp_x ; 

arr_srt[i] . pe n_up=temp_up; 

arr_srt[i] .x_vec=temp_x_vec; 

arr_srt[i] .y_vec=temp_y_vec; 

arr_srt[q.amp=temp_amp; 

arr_srt[i].m=temp_2; 

pr=l; 

} 

else 

{ arr_srtp-1].m=temp_2; 
arr_srt[i].m=tehnp_1 ; 

} 

} 

} 

level=arr_srt[0].m-level; 
if (level<=0.0) leve»=0.0; 
i=0; 

while ((i<j)&&(an_srtp].m >= level)) 

if (i==0) return (0); 
else return(M); 

} 

char mtr_clfint i.char ch) 
{ intj; 
for (j=0;j«i;j++) 

if ( C h==arr_srtfl].letter) retum(arr_srt[D. letter); 
return(arr_srt[OJ.Ietter); 

} 
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Acceleration Recognition 

l» Training procedures 

r—~~* 

To define the works condition. 
f 

void ma in (void) 
{ 

FILE -fp; 
char fiiename[30]; 
int index; 
char num[4]; 
char ch; 
int k; 

printf C Do you want to do PRESS (y/n) : 

ch=getche(); 

fp=fopenCfpr".V); 

if (toupper((int)ch)=«y) fprintf(fp/%d w ( 1); 

else fprintf(fp f ,, %d , \0); 

fclose(fp); 

printf On Do you want to do SMOOTH (y/n) : 

ch=getcheO; 

fp^fopenffsnT.^w"); 

if (toupper((int)ch)==T*) fprirttf(fp ( -%d H ,1); 

else fprintf(fp, ,, %d",0); 

fciose(fp); 

printf On Enter amout of level : 

scanf r%d",&k); 

fp=fopen("flv","w"); 

fprintf(fp,-%d M f k); 

fclose(fp); 



r MAIN FOR TEACHING 

void rnain(void) 
{ 

FILE "fp; 
FILE *fpt;. 
char infile[30]; 
char filename1[30]; 
int number; 
int index; 
int num; 
int nurrwnut; 
char nurn_ch[4]; 
int sp_amount; 
int zon_x[10]; 
int 2on_y[10J; 

float arrjc[NUMBER_OF_STROKES]; 
float arr_y[NUMBER_OF_STROKESJ; 
float arr_z[NUMBER_OF~STROKESJ; 
float arr_p[NUMBER_OF_STROKES]; 
int x t y,z,p t pen_old,i; 
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int arr_beg_end[2j; 
fp1=fopen fabcVr"); 
while ( fscanf(fp1 ,"%<f\& number) !=EOF) 
{ 

fecanf (fpV%s\n"Jnfile); 
if ((fp*fopen(infilerO) =s:: NULL) continue; 
printff— %s— Vn",infile); 
sp_amount=0; 
num=0; 
num_mut=Q; 
pen_oW=1; 

white (fscanf(fp,-%d-,&x)!=EOF) 
{ fecanf(fp f - %d %d %d\n w t &y,&z.&p); 
if (pen__old==p) 
{ 

an_x[num]=(float)x; 
arr_yjnum]=(float)y; 
an_z[num]=(float)z; 
num++; //amount in the space 
if (num > NUMBER_OF_STROKES) 
{ printf CAmount of penstrokes in the space is bigger then %d\n",NUMBER_OF STROKES); 

getchO; ~ 

extt(0); 

} 

num_mut++; //amount in the file 

) 

else 

{ prep(num,num_mut,sp_amount f aiT_x,aiT - y f arr_z); 
sp_amount++; //amount of space 
pen_oW=p; 
arr_x[OJ=(float)x; 
arr_y[0]=(float)y; 
an_z[01=(float)2; 
num=1; 
num_mut++; 

} 

fscanfCfp," %d %d %d %d",&x.&y t &z t &p); 
fscanf(fp,- %d %d %d %d- 1 &x,&y,&z,&p); 
fscanf(fp,- %d %d %d %d-\&x,&y.&z,&p); 

} 

-fclose(fp); 

prep(num t num_mut,sp_amount,arr_x,an_y,an*_z); 
strcpy(filename1 t T)\ 
sprintf(num_ch ( "%d M ,sp_amount); 
strcat(filename1 ,num_ch); 
strcat(filename1 ,-.out"); 
fp=fopen(filename1 ."a+"); 

fprintf(fp l "%d %d %d\n" f number,sp_amount,num_mut); 
for (i=0;i<=sp_amount;i++) ~ 

{ nul_zone(i,an_beg_end); 

save(i , n unrwnut , an_beg_end ,f p) ; 

} 

fclose(fp); t. 
} 

fcJose(fpl); 
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Get w ork's conditions. 

— / 

void prep(int numjnt num_mut,int sp_amount,float arrjcQ, 

float arr_y[] t f]oat arr_zn) 

FILE *tp; 

int pr t sm l amount_lev; 
if ((fp=fopennpr","n)=NULL) 
{ printf("lmpossible to open the file fpAn"); 

getchO; 

exit(O); 

} 

fscanf(fp,"%d-\&pr); 

fclose(fp); 

if (pr) 

{ press(num,arr_x); 
press(num,aiT_y); 
press(num f arr_z); 
num=PRESS_NUMBER_POINT; 

} 

if ((fp=fopenrfemVO)==NULL) 
{ printfflmpossibte to open the file TsnrAn"); 
getchO; 
exit(O); 

} 

fecanftfp.^/od-.&sm); 

fclose(fp); 

if(sm) 

{ smooth(num,arr_x); 
smooth(num,arr_y); 
smooth(num,arr_z); 

} 

leveKnum.num^mirt.sp^amountarr^x.arr^y.aiT^z); 



Save one space information to output file. 

*~ ~* ~7 

void save(int space.int num_mut,int arr_beg_endO,FILE *fp) 
{ «nt i j; 

fprintf(fp, w %d\n",space); 

fprintf(fp,"%d %f yofVn-.glspacel.num^lspacel.beg^floaQnum^mut, 

g [space] .end/(float)num_mut); 

for 0=0 j < g[space].num; j++) 
fprintf(fp.-%d %d %d\n w .gtspaceJ.fO].x.g[space].fDJ.y,glspace].f[jl.z); 

fprintf(fp,"%f %fVn w .(float)arr_beg_end[OJ/(float)g[space].num f 
(float)arr_beg_end[1]/(float)g[space].num); 
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10 



15 



Calculate coordinates accordingly to amount of levels. 

m m / 

void level(int num.int num_mut,int space.float arrjtQ, 

float arr_yD .float arr_zQ) 

{ intij; 
FILE *fp; 

float min_x=9999.0; 
float max_x«0.0; 
float minjy=9999.0; 
float max_y=0.0; 
float min_z=9999.0; 
float max_z=0.0; 
int sum; 
int pn ' 
int temp; 
float kx,ky,kz; 
int lev; 

/ 

20 k-amount of level 

/ 

if ((fp=fopenCflvVn)==NULL) 
{ printfOmpossible to open the file 'fWVn"); 
getchO; 

25 exit(O); 

} 

fscanf(fp, M %d" ( &lev); 
fclose(fp); 
for (i=0;i<num;H-+) 
30 { if (arr_x[i] < min_x) min_x = arr_xp]; 

if (arr_x[i] > max_x) max_x = arr_x[Q; 

if (arr_y[i] < min_y) min_y = arr_y[i]; 

if (arT_y[fl > max_y) max_y = arr__yO]; 

if (arr_z[il < min_z) min_z = arr_zp]; 
35 if (arr_z[i] > max_z) max_z = arr_zpj; 

} 

kx«(max_x-min_x)/(float)lev; 
ky=(max_y-min_y)/(float)lev; 
kz=(max_z-min_z)/(float)lev; 
40 if < (kx <= 1 .00) || (ky <= 1 .00) || (kz <= 1 .00) ) 

{ printff -Decrease the number of levels !!!-\n"); 
getchO; 

} 

for (i=0;i<num;i++) 

{ g[space] .f[i] .x= Ont)(((float)(arr_x[Q-min_x)-0.001 )/kx) 
g[space].fiq.y=Ont)(((float)(aiT^[il-min_y)-0.001)/ky) 
g[space].f[Q.z=Cint)(((float)(arr_z[i]-min_z)-0.001)/kz) 

} 

g[space] .num=num; 
g[space].beg=(float)(num_mut-nurn+1); 
50 g[space].end=(float)(num_mut); 



45 



Calculate the coordinates of null zone. 
/ 



55 void nul_zone(int space.int arr_beg_endO) 

{ int beg.end.dif; 
int beg_rnax .end_max ; 
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10 



15 



20 



int pr=0; 
int j; 
dif=0; 
beg=0; 
end=0; 

for (pO;j<g[space].num;j++) 
{ if (g[space].f[fl.z— 0) 
{ if(pr=-0) 
{ beg=j; 
end=j; 
pr=1; 

if 0==(g[space].num-1)) 
{ if ( dif < 1 ) 

{ beg_max=beg; 
end_max=end; 

} 

} 

} 

else 

{ if 0==(g[space].num-1» 
{ end=j; 
if (dif < (end-beg+1) ) 
{ beg_max=beg; 
end max- end; 

} 

} 

} 

} 

else 

{if (pr==1) 
{ end=j; 
pr=0; 

if ( dif < (end-beg) ) 
{ dif-end-beg; 

35 beg_max=beg; 

end_max=end-1 ; 

} 

} 

} 

40 } 

arr_beg_end[0J=beg_max+1 ; 



25 



30 



arr_beg_end[1]=end_max+1 ; 



45 Do smoothing. 



! 

float smooth 1 ( int num , float zfl ) 

int ind ; 

50 float temp ; 

float norma ; 

for (ind • 1 , norma = 0 ; ind < num - 1 ; ind++ ) { 
temp = ( z[ind -1]+z[ind]+z[ind+1] ) /3. ; 
norma += abbs ( zlind] - temp ) ; 
55 zpnd] = temp ; 

} 

return norma ; 

} 
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void smooth(int max _j>ointfloat arrO) 
{ float nd_smooth; 

white ( ( end_smooth = smoothl ( max_point ( arr ) ) > PRESS NUMBER POINT / 10 ) 
} ~ 

/ — 

Change file coordinates accordingly new length. 

n,uui.^„u il u,u.. : -„ / 

void normal ( int num_old , float arr_oldn , int num new , float arr newfl ) 
{ 

double koeff ; 

int ind_old , ind_new ; 

koeff = (double) ( num_old - 1 ) / (float) ( num_new - 1 ) ; 
arr_new[0] = arr_old[0] ; 

for ( ind_new = 1 ; ind_new < num_new - 1 ; ind_new ++ ) { 
ind_old = (int) ( floor ( koeff * lnd_new ) ) ; 

arr_new[ind_new] = ( ind_old + 1 - koeff • ind.new ) * arr_oldpnd_otd] + 
( koeff • ind_new - ind_old ) * arr_oldpnd_old + 1] ; 

arr_new[ind_new] = an_old[num_old-1J ; 

> 

void press(int num.float arrQ) 
{ float new_arr[100]; 
int t; 

normal ( num . arr , PRESS_NUMBER_POINT , new_arr) ; 
for ( i = 0 ; i < PRESS_NUMBER_POINT; i++ ) 
arrp] = new_arrpl ; 



II. Generalization procedures 

r MAIN FOR GENERALIZATING */ 

void main(void) 

{ 

void generfint i,char filenamefl.char filenamelQ); 

FILE *fp.*fp1; 
int i; 

char num[4]; 

char filename[30],filename1[30]; 
for (i=0;i<NUMBER_SPACE;i++) 
{ strcpy(filename,"r); 

sprintf(num,"%d" t i); 

strcat(filename,num); 

strcat(filename,\out N ); 

if ((fp^or^n(filename, w O)^NULL) continue; 
fclose (fp); 

strcpy(filename1 ,"g"); 
strcat(filename1 ,num); 
strcatffilenamel ".out"); 
fp1 =fopen(filename1 ,"W); 
fclose(fpl); 

g nerO.filename.filenamel); 
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void deLpar(float arr[MAX — REPRESh4T+1][NUMBER_SPACE+1],int amount, 

int space t char filenamelQ); 
void open_file(char filenamelQ.int amountjnt letter) 
{ FILE *fp; 

fp=fopen(filename1 ,"a+"); 

fprintf(fp,"%d %d\n",letter,amount); 

fclose(fp); 

} 

r~~~~ » 

Generalize information for all the letter. 

void gener(int i,char filenameQ.criar filenamelQ) 

int gether(int letterjnt num_space,char filenameQ.char filenamelQ); 
*nt j; 

int amount; 

for 0=0;j<SYMBOLS_NUMBER;j++) 
{ amountegetherGxfilename.filenamel); 

} 

I 

Generalize information for one letter. 

int gether(int letter.int num_space,char filenameQ,char filenamelQ) 
{ int amount; 

FILE *fp; 

FILE*fp1; 

int in,space t num_mut t sp_num,x,y f z,i l j I length ? l; 

float spaceJengm[MAX.REPRESNT+1][NUMBER_SPACE+1]; 

float beg[MAXJREPRESNT+1][NUMBER_SPACE+1]; 

float end[MAX_REPRESNT+1l[NUMBER_SPACE+1J; 

float nul_beg[MAX_REPRESNT+1][NUMBER_SPACE+1]; 

float nul_end[MAX_REPRESNT+1][NUMBER_SPACE+1]; 

int temp; 

float mutJen[MAX_REPRESNT+1][NUMBER_SPACE+1]; 
amount=0; 

f p=f open (fi lename.T) ; 
fpl =fopenOemp- ( "W"); 
fdose(fp1); 

fpl =fopen("tempY*a+"); 
while (fecanfffp/W'.&inJNEOF) 
{ fscanf(fp, H %d %d\n-,&space 1 &num_mut); 
mutjen[amount][0]=(float)num_mut; 
for (i=0;i<=space;i++) 
{ fscanf(fp, M %d",&sp_num); 

fscanf(fp/%d %f %f\n",&temp ( &begtamount][i].&end[amountl[i]); 

spacejength[amount][i]=(float)temp; 

if (letter==in) 

{// fp1=fopenCtempVa+-); 
fprintf(fp1 r%dW,temp); 
if (amount==MAX_REPRESNT) 
{ fclose(fp); 
fclose(fpl); 

printffR pres ntation is too hug \n"); 

getchO; 

return(777); 

} 
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for (j=0J<temp J+-+) 
{ fscanf(fp,"%d %d %d\n'\&x,&y,&z); 
fprintf(fp1 . M %d %d %d\n",x,y.z); 

> 

} 

else 

{ for (j=0J<temp 

fscanf(fp, M %d %d %d\n" l &x,&y f &2); 

} 

fscanf(fp,"%f %f\n w t &nuLbeg[amount][i] l &nuLend[amountl[i]); 

} 

if (Ietter^=in) amount-***; 

} 

fclose(fp); 
fclose(fp1); 
if (amount>0) 

{ open_file(filename1 ,amount,letter); 
defjar(mutjen l amount l 0,filename1); 
def_par(space_length ( amount,space ) filename1); 
def_par(beg ,amount f space,filename1 ); 
def^paKend^mountspace.filenamel); 
def_par(nuLbeg,amount,space ( filename1); 
def_par(nuI_end,amount,space,filename1); 
fp=fopenCtempVO; 
fp1 -fopen(fiiename1 , "a+"); 
for (i=0;i<=space;i++) 
{ for 0=O;j<amount;j++) 

{ fscanf(fp t it %d\n w I &length); 
fprintf(fp1 ^odXrTJength); 
for (l=0;Klength;H-+) 
{ fscanf(fp, M %d %d %dYn" i &x,&y I &z); 
fprintf(fp1."%d %d %d\n M ,x,y,z); 

} 

} 

} 

fclose(fp); 
fclose(fp1); 

} 

return(amount); 



Calculates medial x and y coordinates and their dispersions. 

1 """ ~ ' l,1L1± * «*/ 

void def_par(float arrfMAX.REPRESNT+IJINUMBER.SPACE+ll.int amount, 

int space, char filenamelQ) 

{ int countj; 

float dev[NUMBER_SPACE+1J; 
float mid!l[NUMBER_SPACE+1]; 
float summ; 
float temp; 

float maxINUMBER_SPACE+1J; 
float min[NUMBER_SPACE+1]; 
FILE *fp; 

for (i=0;i<=space;i++) 
{ max[Q=0.0; 
min[i]=9999.9; 
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} 

if (amount>0) 

{ for (count=0;count<=space;count++) 
{ summ=0.0; 
for 0=0; i< a mount; 
{ summ=summ+arr[i][count]; 

if (max[count] < arr[i][count]) max[count] = arr[ij [count]; 
if (min[count] > arrfi] [count]) min[count] = arr[Q[count]; 

} 

midlI[count]-summ/(float)amount; 
summ=0.0; 

for (i=0; iomount; i++) 
{ temp=mid!l[count] - arr[i] [count]; 
summ=summ + temp*temp; . 

} 

dev[count]=sqrt(summ/(float)amount); 

} 

} 

fp=fopen(filename1 t M a+"); 

for (count=0; count<=space; count**) 

fprintf(fp,"%f %f %f %f\n^midli[(X)urt^dev[count],maa[count] I min[count]); 
fprintfCfp.^n"); 
fciose(fp); 
return; 

} 

function calc_vec calculates medial x and y coordinates and their dispersions 
of the vector joining the first point of the symbols' trajectory and the last 



void calc_vec(int amount) 
{ int count.i; 

float summj=0.0; 

float surnm_2=0.0; 

float surnm_3=0.0; 

float summ_4=0.0; 

float surnrrMm=0.O; 

float summ_2m=0.0; 

float summ_3m=0.O; 

float summ_4m=0.0; 

float temp; 

int ami ,am2,am3,arn4,am5,arn6,am7,am8; 
if (amount>0) 
for 0=0; i<amount; 
{ sumn\_1 =sumrrM +bx[i][0].x_b; 
summ_2=summ_2+by[i][0].y_b; 
su mm_3=summ_3+bx [i] [0] .x_e; 
su mm_4=summ_4+by[i] [0] .y_e; 

} 

x_midll[0].x_b=summ_1/(float)amount; 

y_midll[0].y_b=summ_2/(float)amount; 

x_midll[0] .x_e=summ_3/(float)amount; 

y_midll[0].y_e=summ_4/(float)amount; 

surnm_1 =0.0; 

summ_2-0.0; 

summ_3=0.0; 

summ_4=0.0; 

summ_1 m=0.0: 

summ_2m=0.0: 
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summ_3m=0.0; 

summ_4m=0.0; 

am1=0; 

am2=0; 

am3-0; 

am4=0; 

am5=0; 

am6=0; 

am7=0; 

am8=0; 

for (i=0; i<amount; 
{ temp=x_midll[0] jc_b-bx[i][0] jc_b; 
if (temp>0.0) 

{ summ_1=summ_1+temp*temp; 
am1++; 

> 

else 

{ summ_1 m=summj m+temp*temp; 

anrt2++; 

} 

temp=y_midll[0] y_b-by [Q[0] .y_b; 
if (temp>0.0) 

{ summ_2=summ_2+temp~temp; 
am3++; 

} 

else 

{ summ_2m=summ_2m+temp*temp; 
am4++; 

} 

temp=x_midll[0].x_e-bx[i3[0].x_e; 
if (temp>0.0) 

{ sumrn_3=summ_3+temp*temp; 
am5++; 

} 

else 

{ summ_3m=summ_3m+temp*temp; 
am6++; 

} 

te mp=y_midll[0] .y_e-by [ij [0] .y_e; 
if (temp>0.0) 

{ summ_4=summ__4+temp*temp; 
am7++: 

} 

else 

{ summ_4m=summ_4m+temp*temp; 
amB++: 

} 

} 

if (am1==0) x_dev[0] jc_b=0.0; //dev- 
else x_dev[0].x_b=sqrt(summ_1/(float)aml); 
if (am2==0) x_dev[1]jc_b=0.0; //dev+ 
else x_devl1].x_b=sqrt(summ_1 m/(float)am2); 
if ((ami +am2)~0) x_dev[2] .x_b=0.0; //dev 
else x_dev[2].xj3=sqrt((summ_1+summ_1 m)/(float)(am1+am2)); 
if (am3==0) y_dev[0].y_b=0.0; //dev- 
else y_dev[0] .y_b=sqrt(summ_2/(float)am3); 
if (am4==0) y_d v[1J.y_b»0.0; //dev+ 
Ise y_dev[lJ.y_b=^qrt(summ_2rn/(float)arn4); 
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if ((am3+am4)==0) y_dev[2].y_b=0.0; //dev 

else y_dev[2] y_b^qrt((summ_2+summ_2m)/(float)(am3+arn4)) ; 

if (am5=0) x_dev[OJ.x_e=0.0; //dev- 

else x_dev[0].x_e=sqrt(summ_3/(float)am5); 

if (am6==0) x_dev[1].x_e=0.0; //dev+ 

else x^devflJ.x^e^sqrtCsumm^m/CfloatJamS); 

if ((am5+amS)==0) x_dev[2jjc_e=0.0; //dev 

else x_dev[2].x_e=sqrt((summ_3+summ_3m)/(float)(am5+am6)); 

if (am7— 0) y_dev[0|.y_e«0.0; //dev- 

else y_dev[0] y_e=sqrt(summ_4/(float)am7); 

if (am8==0) y_dev[1].y_e=0.0; //dev+ 

else y_dev[1].y_e»sqrt(summ_4m/(float)am8); 

if ((am7+am8)»=0) y_dev{2].y_e=0.0; //dev 

else y_dev[2J.y_e^rt((summ_4+sUmm_4m)/(float)(am7+am8)); 



III, Recognition procedures 

r MAIN FOR RECOGNITION */ 

struct G g[NUMBER_ SPACE]; 

float beg_end[NUMBER_SPACEI[2]; 
void main(void) 

{ 

FILE *fp; 
FILE *fp1; 
char infile[30J; 
char filename - ! [30]; 
int number; 
int index; 
int num; 
int num_mut; 
char num_ch[4J; 
int sp_amount; 
int zon_x[10J; 
int zon_y[10]; 
int letter; 

float arr_x[NUMBER_OF_STROKES]; 
float air_y[NUMBER_pF_STROKES); 
float arr_z[NUMBER_OF_STROKES]; 
float arr_p[NUMBER_OF_STROKES]; 
int x,y,z,p f pen_old f i; 
int arr_beg_end[2]; 

fpl=fopenrcba"rn; 
while (fecanf(fp1, H %d N ,&letter)NEOF) 
{ fscanKfpl.-^sVn^infile); 

if ((fp=fopen(infilG/r)) s =NULL) continue; 

printfC— %s— \n w ,infile); 

sp_arnount=0; 

num=0; 

num_mut=0; 

pen_old=t; 

while (fscanf(fp, w %d".&x)!=EOF) 
{ fscanf(fp,* %d %d %d\n*\&y,&z,&p); 
if (pen_old— p) 
{ 
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arr_x[num]-(float)x; 

arr_y[numJ=(float)y; 

arr_z[num]=(float)z; 

num++; //amount in the space 

if (num > NUMBER_OF_STROKES) 

{ printffAmount of penstrokes in the space is bigger then %d\n".NUMBER_OF_STROKES); 
getchO; 
exit (0); 

} 

nunrwnut++; //amount in the file 

} 

else 

{ prep(num t num_mut,sp_amount,arr_X3rr_y l arr_z); 
sp_amount++; //amount of space 
prep(num,num_mut,sp_amountaiT_x l arr_y I arr_z); 
pen_oW=p; 
arr_x[0]=(float)x; 
arr_y[0]=(float)y; 
aiT_z[0>(float)z; 
num=1; 
num_mut++; 

} 

fscanf(fp • %d %d %d %d",&x,&y,&z ) &p); 
fscanf(fp - %d %d %d %d",&x,&y ( &z l &p); 
fscanf(fp,- %d %d %d %d\&x,&y.&z,&p); 

} 

fclose(fp); 

prep(num, num_mut,sp_amount,arr__x ,arr_y ,an_z); 
strcpy(fllename1 ."rec'O; 
strcat(filename1 ,".ouT); 
fp=fopen(filename1 ,"a+*'); 
fprintf(fp,-%oAn",letter); 
fprintf(fp,-%s\n",infile); 
f printf (fp,"%d %d\n" l sp_amount,num_mut); 
for (i c O;i<=sp_amount;i++) ~~ 
{ nul_zone(i,arr_beg_end); 

save(i,num_mut t arr_beg_end,fp); . 

} 

fclose(fp); 

} 

fdose(fp1); 

} 

int main(void) 
{ 

FILE -fp,'fp2; 
int i.lev j; 

char filenarne[30] .filename! [30]; 

float lev_sort; 

int lev_rb,lev_re; 

fp=fopenfflvVr"); 

fscanf(fp,"%d".&lev); 

fclose(fp); 

printf C Enter level for sorting : "); 

scant C%r,&lev_sort); 

printf (" Enter level for begin null zone: "); 

scanf r%d"i&lev_rb); 

printf (" Enter level for end null zone : 
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scant C%cr\&lev_re); 



// for confusion table 

for (i=0;i<SYMBOLSJNIUMBER;k+) 
for G=0J<SYMBOLCNUMBERj++) 
confpitD=0; 



r 

fp2=f open ("sort. outVa+") ; 
fp^fopenfrec.our.V); 
recogn(fp f fp2Jev,lev_sort,lev_rb ( lev_re); 
fclose(fp); 
fciose(fp2); 
/' ' , 

// for confusion table 
fp=fopenCmatr*/V); 
for (i=0;i<26;i++) 
fprintf(fp f w %c ",(char)(i+97» 
for (i=0;i<26;i++) 
fprintfffp.^/oc ",(char)(i+65)) 
for (i=0;i<10;H~f) 
fprintfCfp.^c \(char)(i+4B)) 
fprintf(fp,"Vn"); 
for (i=0;i<62;i++) 
{ for 0=0 u<62 j++) 
fprintf(fp,-%d ".confpjffl); 
fprintf(fp,"\n"); 

} 

fclose(fp); 



return 0; 



Cre ate sort ing array according to sorting level. 
* / 

int cutt_sort(int num.float lev_sort f struct S sortQ) 
{ int ij; 

float lev; 

float max=0.0; 

for (i=0;i<num;H-+) 
if (sortpj.w > max) max=sort[i].w; 
lev=max-lev_sort; 
if (lev <= 0.0) lev=0.0; 
H>: 

for (i=0;i<num;i++) 
if (sort[i].w >= lev) 
{ if (j!=0 sort[j]=sortp]; 

} 

returnfl); 

} 

int sort_funct( const void *a, const void *b) 

{ if (((struct S -)a)->m > ((struct S *)b)->m) return(-1); 

if (((struct S *)a)->m < ((struct S *)b)->m) return(1); 

return (0); 

} 
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/ 

Create file sign recognition. 

j 

void recogn(FILE *fp,FILE *fp2,int lev.float lev sortjnt lev rb.int lev re) 
struct S sort[SYMBOLS_NUMBER]; 

FILE *fp1; 

char filename1[30]; 

float begfNUMBER SPACE]; 

float end[NUMBEFTsPACE]; 

int space f num_mut,space_cur; 

double koef; 

int number,! j.letter.amountjength.l; 
char num[5J; 
float midfl,dev,metr; 
float x[NUMBER_OF_STROKES]; 
float y[NUMBER_OF_ STROKES]; 
float z[NUMBER_OF_STROKES]; 
float x__rec[NUMBER_OF_STROKES] ; 
float y_rec[NUMBER_OF_STROKES]; 
float z_rec[NUMBER_OF_STROKES); 
float new_arr[NUMBER_OF_STROKES]; 
int tempi ,temp2,temp3; 
float max.min; 
float summ; 
float summt; 

float m[MAX_REPRESN7]INUMBER_SPACE]; 

float mi[MAX_REPRESNTl[NUMBER SPACEJ; 

float b_0[NUMBER_SPACE]; 

float e_0[NUMBER_SPACE]; 

float mult; 

int symb_num; 

char name_file{20]; 

float lev_sort1 ; 

int num_for_sort; 

char letter_print; 
int SeqNo; 

while (fscanf(fp,"%d\n-,&number)!=EOF) 
{ fscanf(fp t -%s\n",name_file); 
printfC^sVn-^ameJile); 

fscanfCfp.^/id %d\n\&space,&num_mut); /"letter from recognition ser/ 
for (i=0;i<=space;i++) 
{ fscanf(fp/%d\n",&space_cur); 

fscanf(fp,-%d %f %nn",&g[space_cur].num f &g[space_cur].beg I 

&g[space_cur] .end) ; 

for (j°0;j < g[space_cur].num; J++) 
fscanf(f P( -%d %d %d\n M ( &g[space_cur].f[fljc, 

&9[space_cur].fD].y r &g[space_cur].fI0.2); 
fscanf(fp-%f %f\n",&beglspace_cur],&end[space_cur]); 



strcpy(filename1 ,"*g"); 
sprintf(num.*%d* t space); 
strcat(filename1 ,num); 
strcat(filename1 ,\our); 
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fp1=fopen(fi!ename1 
symb_jium=0; 

while (fscan^fpl.^d^.&sorqsymb^umJ.letteONEOF) Hetter from gen set*/ 
fscanf(fp1 ,-%d w t &amount); 

fscanf(fp1 , M %f %f %f %nn tt ,&midll t &dev,&max i &min); 
sort[symb_num].mutJen= 

mut_metric((float)num_mut ) midli l 0.0 > 1500.0,dev,dev); 

fscanf(fp1 ,"\n"); 

for (i=0;i<=space;i++) 

{ fscanf(fp1 t a> %f %f %f %f\n-,&midll,&dev,&max,&min); 

mult=1.0; 

fecanf(fp1/An"); 

for (i 3= 0;i <e space;i++) 

{ fscanf(fp1,-%f %f %f %fVn H l &midll t &dev,&max f &min); 
if (i%2==0) 

mur^m^metricigpl.beg.midH.O.O.I.O.dev.dev); 

fscanf(fp1 ,~\n m )\ 

for (i«0;i<=space;H-+) 

{ fccanf(fp1,-%f %f %f %1\n^&midll,&dev,&max,&mln); 
if (f%2==0) 

mur=mut_rnetric(gli].end f nrwdll f 0.0 t 1.0,dev,dev); 

} 

sort[symb_num].beg_end=murt; 

fscanf(fp1 ,"Vn"); 

for (isO;i<«space;i++) 

{ fscanf(fpV%f %f %f %ftn",&midH t &dev f &max,&min); 

fscanf(fpl,-\n~); 

for (i=0;i<=space;i++) 

{ fecanf(fpV%f %f %f %fVn w ,&mid!Udev ) &max,&min); 

fscanRfpl.^Xn"); 
for (l=0;i<amount;l++) 
{ for (j=0 j<=space;j++) 
{ fscanf(fp1 ,"%d\n" t &length); 
for (l=0;l<length;H-+) 

{ fscanf(fp1 t "%d %d %d\n M ,&temp1 f &temp2 f &temp3); 
x[[)=temp1 ; 
y[0=temp2; 
2[Q=temp3; 

} 

for (l=0;l<g[fl.num;l++) 
{ x_rec[0=g[fl.f[l].x; 

y_rec[I]=g[j].f[f].y; 

2_rec[0=g[fl-fl0z; 

} 

rf (length < g[fl.num) 
{ 

normal ( length , x , glfl.num , new_arr) ; 

summ=metric(x_rec,new_arr I g[jJ.num i lev); 

summl=metricl(x_rec,n w_arr,g[fl.num t levj v_rb.lev.je); 
norma! ( length , y , g[j].num , new_arr) ; 
summ+=metric(y_rec ) new_arT l gIfl.num ( lev); 
summl+-metricl(y_rec,new - arT l g[jI.numJev ( lev_rb l lev_re); 
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normal ( length , z , g[Q.num , new_arr) ; 

sumnr^=metric(z_rec ) new_arr,g[fl.num l lev); 

summl+=metricl(z_rec,new_arr,g[0.num t lev,lev_rbjev - re); 

mRJ[0=1-surmi/3; 

ml[i][fl=l-sumrnl/3; 

} 

else 
{ 

normal ( gffl.num , x_rec , length , new_arr) ; 
summ=metric(x , new__arr , length, lev); 
summl=metricl(x t new_arrjength,lev f lev_rb,lev_re); 

normal ( g[Q.num , y_rec , length , new_arr) ; 
summ+-=metric(y , new__arr , length.lev); 
summH-=metricl(y t new_arr t length,levJev_rb f lev_re); 

normal ( g[fl.num , z_rec , length , new_arr) ; 

summ+=metric(z , new_arr , length.lev); 

summl+==metricl(z 1 new_arr ( length,lev ( lev_rb ( lev re); 
m[i][fl=1-summA3; 
m![J][i]=l-summl/3; 

} 

} 

} 

metr^O.O; 

for (i=0;i<=space;H-+) 
{ max-O.O; 
for (j=OJ<arnount;j++) 
if (max < mfflRD max=m[fl[i]; 
metr+=max; 

} 

sort[sy mb_num] . w=metr/(space+ 1 ) ; 
metr=0.0; 

for (i=0;i<=space;i++) 
{ max=0.0; 

for O m OJ<amountJ++) 

If (max < mlD][i]) max=ml[fl[i]; 

metr+*max; 

} 

sort[symb_num].m_0=metr/(space+1); 

sort[symb_num].m=(sort[symb_num].w+sort[symb_num].mutJen+ 
sort[symb_num].beg_end)/3.0; 

symb_num++; 

} 

fclose(fp1); 

num_for_sort=cutt_sort(symb_num,lev_sort f sort); 
if (num_for_sort>1) 

qsort{sort,num_for_sortsizeof(struct S) ,sort_funct)- 

i=0; 

if (name_file[0] !=*b} 
{ letter jrint=name_file[0]; 

SeqNo=(int)(name_fiIe[2]-48); 

else 

{ if (isdigit( (int) name_file[1] ) !=0) 
{ letter_print==name__file[0]; 
S qNo=(int)(name_file[2]-48); 
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else 

{ letter_print=toupper ( name_file[1] ); 
SeqNo=(int)(name_filet3]-48); 

}. 

} 

fprintf(fp2," — %c0%d — LeveN%f %d\n" I letterj)rint 1 SeqNo f lev_sort,num_for_sort); 

r / 

// for confusion table 

conf[numbeM][sort[0].letter-1]++; 

/ / 

while (i<num_for_sort) 
{ fprintf(fp2,-%3d w ,sort[i] .letter); 

fprintf(fp2,-W=%.5f mutjen=%.5f beg_end=%.5f m_0=%.5f midll=%.5nn" ( 
sortH.w,sort[i].mirtJen,sort[q.beg_end t s^^ 

} 

} 

} 



r~ ~* 

similarity function defines similarity between parameter and sample of 
parameters with known medial t left and right deviation , and range of definition 
(constJ 1 const_r) 

float mut_metric(float param.float medial/float constJ,float const_r, 

float devj.float dev_r) 

{ float left,right,m t div; 
left=medial-devj; 
if (left<constJ)7eft=constJ; 
right=mediaH-dev_r; 
if (right>const_r) right=const_r; 
if ((param >- left)&&(param <=right)) 

Teturn(1.0); 

else 

{ div=const_r-constj-right+left+0.0001 ; 
if (div— 0.0) div=medial; 
if (param < left) 

m=1.0 - (left-param)/div; 
if (param > right) 

m=1 .0 -(pararrwight)/div; 

} 

if (m<0.0) m=0.0; 
retum(m); 

} 

Calculate file coordinates accordingly new length. 

M,lu " i - i_ " ' / 

void normal ( int num_old , float arr_old[] , int num_new , float arr_new[] ) 

double koeff ; 

int ind_old , ind_new ; 

koeff = (double) ( num_old - 1 ) / (float) ( num_new - 1 ) ; 
arr_new[0] = arr_old[0] ; 

for ( ind_new = 1 ; ind_new < num_new - 1 ; ind_ new ++ ) { 
ind_old = (int) ( floor ( koeff * ind_new ) ) ; 

arr_new[tnd__new] = ( ind_old + 1 - koeff * ind_new ) * arr_old[tnd_old] + 
( koeff * ind_new - ind_old ) * arr_oldpnd_old + 1] ; 
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arr_newpnd_new] = arr_old[num_otd-1] ; 

} 

/ 

Calculate, levers metric. 

5 "" ,limmi - 11 / 

float metric(float z1Q , float z2Q ,tnt length,int lev) 
{ inti; 

float summ=0; 

for fi=0;i<length;i++) 
10 sumn*=sumrmfabs(z1 p]-z2[I]); 

return(summ/(float)(length*(lev-1))); 

} 

r *■ 

Calculate zone metric. 

15 ' 

float metricl(float aQ.float bQ.int length.int levjnt beg.int end) 

int calc=0; 
int i; 

20 float s=0.0;calc=0; 

for 0=0; i < length ; H~f ) 
{ 

if («a[0 <= (fIoat)end)&&(a[fl >= (float)beg))||(( bffl<= (float)end)&&( bp] >== (float)beg))) 

25 s+=fabs(a[i]-bril); 
calc++; 

} 

} ' 
if(calc==0) s=1 ; 
s=1.0-s/(float)(calc*(lev-1)); 
retum(s); 
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Combined results from Graphic tablet's and acceleration's recognition 

struct TAB_ACS 
{ char name; 
float tab_w; 
float acs_jv; 
float y; 
float x; 
float x_vec; 
float y_vec; 
float amp; 
int up; 
float m_tab; 
float mutjen; 
float beg_end; 
float m_acs; 
float midll; 

}; 

int matr[100][l00]; 

void write_matr(void) 
{ FILE-fout1; 
int i j; 

foutl = fopen f matrix .t_a",\0'r 
for (i=0;i<26;i++) 

fprintf (foutl t ~%c *,97+i); 
for (i=0;i<26;M-+) 

fprintf (foutl ,"%c ",65+i); 
fprintf (foutl ,"\n"); 
for (i-0;i<52;H-+) 
{ for O=0y<52 

fprintf (foutl f "%d ".matrpJlfl); 

fprintf (foutl, •An"); 

} 

fclose(fout1); 



char conv_char(int in_name) 

{ if (ln_name < 27) return ( (char) (in_name + 96) ); // a-z 1-26 
if (in_name < 53) return ( (char) (in_name + 38) ); // A-Z 27-52 
if (in_name < 63) return ( (char) (in_name - 5) ); // 0-9 53-62 
return(O); 

} 

int conv_int( char a) 

{ if ( a < 58 ) return ( (int)a + 4 ); 

if ( a < 91 ) return ( (int)a - 39 ); 

if ( a < 123) return ( (int)a - 97 ); 

return(O); 



void matr_add( char a , char b ) 
{ matr[convJnt(a)l(convJnt(b)]++; 
} 

int sort_funct( const void *a, const void *b) 
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{ if (((struct TAB_ACS *)a)->midll > ((struct TABJVCS *)b)->midll) return(-1); 
if (((struct TAB__ACS w )a)->midll < ((struct TAB_ACS ")b)->midll) rehirn(1); 
return(O); 

} 

void main (void) 
{ struct ACS 

{ char name; 

float w; 

float muMen; 

float beg_end; 

float m_0; 

float midll; 

}: 

struct TAB 

{ char name; 
float w; 
float y; 
float x; 
float x_vec; 
float y_vec; 
float amp; 
int up; 
float m; 

}; 

struct TAB tab[100]; 

struct ACS acs[100]; 

struct TAB_ACS tab_acs[1 00]; 

FILE -fp,-fp1,*fout; 

int i j.k.l; 

char name_fiie_tab; 

char name_file_acs; 

int num_file_tab f num_file_acs; 

int num__tab,num_acs; 

int in_name: 

float temp; 

char tempc: 

int pr; 

int find_file: 

fp=f open fadd^err' " r") ; 
f p 1 -i open f sort . out V r") ; 
fout=fopenf combineTw**); 

while ( fscanf(fp,"%c %d N l &name_file_tab l &num_file_tab)!-EOF) //add err 
{ 

find_file=0; 

printff— %cO%d— \n\namejilejab ( num_file tab); 
fseek(fp,8.1); 

fscanf(fp.^/odVn",&num_tab); 
for (i=0;i<num_tab;i++) 
{ fscanf(fp,"%c N ,&tabp].name); 

fecanf(fp,*w=%6f ",&temp); 

tab[i].w=temp; 

fscanf(fp ( "y=%6f w ,&temp); 

tab[i].y=temp; 

fscanf(fp,"x=%6f ",&temp); 

tab[i].x=temp; 

fscanf(fp,Xyec=%6f ".&temp); 
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tab[Q.x_vec=temp; 
1scanf(fp,"y_yec=%6f ",&temp); 
tab[i].y_v c=temp; 
fecanf(fp,"amp=%6f ",&temp); 
tab[i].amp=temp; 
fscanf(fp/ up=%6f ",&temp); 
tab[i].up=temp; 
fscanf(fp, H m=%6f ".fctemp); 
tab[Q.m=temp; 

} 

while (fscanf(fp1 — %c",&name_file_acs)!=EOF) //sort_out 
{ 

fscanf(fp1 /*0%d^&num_file_acs); 
fseek(fp1,21,1); 
fscanf(fp1/*%d\n\&num_acs); 
for (i=0;i<num_acs;i++) 
{ fecanf(fpl ,"%d H p &in_name); 
a cs[i] .name=conv_char(i n_name) ; 
fscanf(fp1 r W=%7r ,&temp); 
20 acs[i].w=temp; 

fscanf(fp1 " mutjen«%7f\&temp); 
acspj.mutjen^temp; 
fscanf(fp1 • beg_end=%7r\&temp); 
acsp] .beg_end=temp; 
25 fscanf(fp1 m_0=%7f\&temp); 

acsp].m__0=temp; 

fscanf(fp1 midll=%7f\n H ,&temp); 

acs[i].midll=temp; 

} 

30 tf ((name_file_acs— name„file_tab)&&(num_file_acs==nurrt_file_tab)) 

{findjile-1; 
break; 

} 

} 

35 if ( find_file == 0 ) 

{ matr_add( name_file_tab , tab[0].name); 
fseek(fp1, 0L, SEEK.SET); 
continue; 

} 

if ( acs{0].name = tab[0].name ) 
{ matr_add( name_file_tab , tab[0].name); 
fseek(fp1 , 0L ( SEEK_SET); 
continue; 

} 

else 
{k«0; 

for (i=0;i<num__tab;i++) 
{ /ttab_acs[k].narne==tab[i].name; 
for O=0;j<num_acs;j++) 
{ if ( tab[i].name == acs[fl.name ) 
50 { tab_acs[k].name=tab[i].name; 

tab_acs[kj.tab_w = tabffl.w; 
tab_acs[k].acs_w = acsjjj.w; 
tab_acs[k].y = tabpj.y; 
tab_acs[kj.x = tab[i].x; 
55 tab_acs[k].x_vec = tab[i].x_vec; 

tab_acs[k).y_yec = tabpj.y_vec; 
tab_acs[k].amp = tab[i].amp; 
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tab__acs[k].up = tab[Q.up; 

tab_acs[k].m_tab = ( acsffl.w + tabffl.y + tab[fl.x_vec + tab[i].amp)/4.0; 
tab_acs[k].mutjen = acsQ-mutJen; 
tab_acs[k].beg_end = acsQ].beg_end; 
tab_acsfk].m_acs = acsQJ.midll; 

tab acs{k].midll = ( tab_acs[k].m_tab + tab_acs[k].acs_w)/2.0: 
k++; 

break; 

} 

} 

} 

fseek(fp1, OL, SEEK_SET); 

) 

fprintf(foutr — %cO%d — %d\n" ( name_file_tab I num_file_tab I l^; 

if ( k=0 ) rnatr_add(nameji!e_tab,tab[0].name); 

else 

{ qsort(tab_acs, k , slzeof(staict TAB_ACS), sortjfunct); 
matr_add(name_file tab,tab_acs[0] .name); 
for (N0;Kk;K+) 

fprintfCfoul,* %c— 4ab_m=%.4f acs_mid!N%.4f tab_acs=%.4f\n", 
tab_acs[l].name , tab_acs[Q.m_tab t 
tab_acs[f).acs_w t tab__acs[Q.rTHdll); 

} 

} 

fclose(fpl); 
fclose(fp); 
fctose(fout); 
write__ matrO; 
return; 
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APPENDIX C 

;PALASM Design Description 

• ■ — Declaration Segment 

TITLE PALASM DESIGN DESCRIPTION 

PATTERN 

REVISION 1.0 

AUTHOR HANNA &VECTOR 
COMPANY BAR_ON 
DATE 02/27/94 

CHIP _PAL PAL22V10 



PIN Declarations 



PIN 


1 


CLK 


COMBINATORIAL 


; CLOCK=12.88MHZ 


PIN 


2 


/RD 


COMBINATORIAL 


•IMDI IT 
.IINrU 1 


PIN 


3 


AO 


COMBINATORIAL 


;INPUT 


PIN 


4 


A1 


COMBINATORIAL 


;INPUT 


PIN 


5 


A2 


COMBINATORIAL 


;INPUT 


PIN 


6 


A3 


COMBINATORIAL 


;INPUT 


PIN 


7 


A4 


COMBINATORIAL 


;INPUT 


PIN 


8 


A5 


COMBINATORIAL 


;INPUT 


PIN 


9 


/RS 


COMBINATORIAL 


;INPUT 


PIN 


10 


/RECO 


COMBINATORIAL 


;INPUT 


PIN 


11 


/REC1 


COMBINATORIAL 


;INPUT 


PIN 


12 


GND 




PIN 


13 


IOCS 


COMBINATORIAL 


;INPUT 






; OUTPUT 


PJN 


14 


/CSCO 


COMBINATORIAL 


;INPUT 


PIN 


15 


/CSC1 


COMBINATORIAL 


;INPUT 


pin 


16 


/R2 


REGISTERED 


PIN 


17 


/R1 


REGISTERED 




PIN 


18 


/RO 


REGISTERED 




PIN 


19 


-MR1 


COMBINATORIAL 


;OUTPUT 


PIN 


20 


MRO 


COMBINATORIAL 


;OUTPUT 


PIN 


21 


OUTR1 


COMBINATORIAL 


;OUTPUT 


PIN 


22 


OUTRO 


COMBINATORIAL 


;OUTPUT 


PIN 


23 


/GD 


COMBINATORIAL 


;OUTPUT 


PIN 


24 


VCC 





STRING ADD1 'IOCS*RD*/A5*/A4*/A3*A2*A1*A0' 
STRING ADD2 'IOCS*RD*/A57A4*A37A27A17A0' 

STATE 

M OOR E_M AC H I N E 

START_UP := POWER UP -> idle 



IDLE := RS1 -> CON1 
+RS2 -> CON2 
+-> IDLE 
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CON1 := /RD -> CON3 
+RD -> CON1 

CON2 := /RD -> CON4 
+RD -> CON2 

CON3 := VCC -> IDLE 
CON4 := VCC -> IDLE 



IDLE= /R0 * /R1 */R2 
CON1= RO * /R1 * /R2 
CON2 = /RO * R1 * /R2 
CON3 = RO * R1 * /R2 
CON4 = /RO * /R1 * R2 



IDLE.OUTF=/MR0*/MR1 
C0N1 .OUTF=/MR0*/MR1 
CON2.OUTF=/MR0*/MR1 
CON3.OUTF=MR0 
CON4,OUTF=MR1 



CONDITIONS 

RS1=ADD1 

RS2=ADD2 



EQUATIONS 
OUTRO = RS*REC0 
OUTR1 = RS*REC1 

GD = IOCS*RD*((/A57A4*/A3*A2*(A0 :+: A1))+CSC0+CSC1) 



simulation 

TRACE_ON CLK RD MRO MR1 IOCS AO A1 A2 A3 A4 A5 
PRELOAD IDLE 

SETF RD IOCS /AO /A1 /A2 /A3 /A4 /A5 

CLOCKF CLK 

CLOCKF CLK 

CLOCKF CLK 

SETF A3 

CLOCKF CLK 

CLOCKF CLK 

CLOCKF CLK 

SETF /RD 

CLOCKF CLK 

CLOCKF CLK 

SETF /IOCS RD /A3 A2 A1 /AO /CSCO /CSC1 
SETF IOCS 
SETF AO /A1 
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SETF /AO 
SETF CSCO 
SETF CSC1 /CSCO 
TRACE OFF 
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;PALASM Design Description 

; Declaration Segment 

TITLE PALASM DESIGN DESCRIPTION 

PATTERN 

REVISION 1.0 

AUTHOR HANNA &VECTOR 
COMPANY BAR_ON 
DATE 02/27/94 



CHIP PAL2 PAL22V10 



15 



PIN Declarations 



20 



25 



30 



35 



40 



PIN 


1 


/RD 


PIN 


2 


FRES 


PIN 


3 


AO 


PIN 


4 


A1 


PIN 


5 


A2 


PIN 


6 


A3 


PIN 


7 


A4 


PIN 


8 


A5 


PIN 


9 


Q0 


PIN 


10 


Q1 


PIN 


11 


/WR 






; OUTPUT 


PIN 


13 


IOCS 


PIN 


14 


/LS 


PIN 


15 


/CSDAC 


PIN 


16 


/CONVST0 


PIN 


17 


/CONVST1 


PIN 


18 


/CSADC0 


PIN 


19 


/CSADC1 


PIN 


20 


aCSCOUNTO 


PIN 


21 


/CSCOUNT1 


PIN 


22 


CPCOUNT0 


PIN 


23 


CPCOUNT1 



INPUT 
; INPUT 
; INPUT 



; — Boolean Equation Segment 

45 EQUATIONS 

LS=IOCS7A5*/A4*/A37A2 

CSDAC=IOCS*WR*/A5*/M7A3*(/A2+A27A17A0) 

CONVST0=IOCS*WRVA57A47A3*A27A1*A0 
so CONVST1 =IOCS*WR7A57A47A3*A2 VA1 7A0 

CSADC0=IOCS7A57A47A3VA27ArA0 

CSADC1 =IOCS7ASVA47A3*A2*A1 7A0 

CSCOUNT0=IOCS*RD7A57A47A3*A27\1 "AO 
ss CSCOUNT1 =IOCS*RD7A57A4*A37A27A1 7A0 

/CPCOUNT0=FRES*Q0 

/CPCOUNT1=FRES*Q1 
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SIMULATION 

TRACE_ON /RD FRES AO A1 A2 A3 A4 A5 QO Q1 /WR IOCS 

SETF IOCS RD WR AO A1 A2 A3 A4 A5 QO Q1 FRES 

SETF /WR /A5 /A4 /A3 /A2 

SETF /IOCS 

SETF IOCS 

SETF /RD WR 

SETF A2 /A1 /AO 

SETF AO 

SETF A1 /AO 

SETF RD /WR AO 

SETF A3 /AO /A1 /A2 

SETF FRES QO 

SETF /FRES /QO 
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;PALASM Design Description 

; Declaration Segment 

TITLE PALASM DESIGN DESCRIPTION 

PATTERN 

REVISION 1.0 

AUTHOR HANNA &VECTOR 

COMPANY 

DATE 02/27/94 

CHIP _cs PAL22V10 



PIN Declarations 



PIN 


1 


A6 


; INPUT 


PIN 


2 


A7 




PIN 


3 


A8 




PIN 


4 


A9 




PIN 


5 


A10 




PIN 


6 


A11 




PIN 


7 


A12 




PIN 


8 


A13 




PIN 


9 


/DMS 


; INPUT 


PIN 


10 


/PMS 


; INPUT 


PIN 


11 


/RD 


; INPUT 


PIN 


14 


/DMS0 


; OUTPUT 


PIN 


15 


/DMS1 


; OUTPUT 


PIN 


16 


/PMS0 


; OUTPUT 


PIN 


17 


/PMS1 


; OUTPUT 


PIN 


18 


/DMRD 


; OUTPUT 


PIN 


19 


/IOCS2 




PIN 


20 


IOCS1 





; ; Boolean Equation Segment 

STRING IO A1 3*A1 2*/A1 1 *A1 0*A9*A8*A7*A6* 



EQUATIONS 

IOCS1 = IO*DMS 
IOCS2 = IO*DMS 
DMS0 = /A13*DMS 
DMS1 = A13*DMS 
PMS0 = /A13 *PMS 
PMS1 a A13 * PMS 

DMRD = (/A13+/A12+A11+/A10+/A9+/A8+/A7+/A6)*DMS*RD 

; Simulation Segment 

SIMULATION 

trace_on IOCS1 IOCS2 DMS0 DMS1 PMS0 PMS1 DMRD 
SETF A13 A12 A11 A10 A9 A8 A7 A6 DMS /RD /PMS 
SETF A13 A12 A11 A10 A9 A8 A7 A6 /DMS /RD PMS 
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SETF A13 A12 /A1 1 A10 A9 A8' A7 /A6 DMS RD 
SETF A13 A12 /A1 1 A10 A9 A8 A7 A6 DMS RD 
SETF /A13 /DMS PMS 
SETF /A13 DMS /PMS 
SETF A13 
SETF /DMS PMS 



146 



EP 0 666 543 A2 



. MODULE /S EG =prog mem ibmstr02; APPFMnTY n 

. ENTRY ~ Startup; IA ° 

. INCLUDE <d: \adi_dsp\include\def 2101 . h> ; 

. CONST TSCALE=0; 

. CONST TCOUNT=0x8 f f f ; 

. CONST TPERIOD=0x8f f f ; 

.VAR/CIRC/DM/RAM/SEG=data_mem Package [4] ; 

. VAR/ CIRC/DM/RAM/SEG-data_mem Shifter Const [8] ; 

. VAR/CIRC/DM/RAM/SEG=data_mem Masks [8] ; 

. GLOBAL Package; 

. GLOBAL Shifter__Const ; 

. GLOBAL Masks; 



Shif ter_Const : <sh_const .dat> ; 
Masks : <masks . dat > ; 



{ Set System Control Register : SPORT0 -enable, SPORT1 -enable 

AX0=0xlclf ; 

DM (Sys_Ctrl_reg) =AX0 ; 



{ Load Tperiod Register for 10 milliseconds 

AX0=TPERIOD; 

DM (Tperiod_Reg) =AX0 ; 



{ Load Tcount Register for 10 milliseconds 

AX0=TCOUNT; 

DM ( Tcount_Reg ) » AXO ; 



{ Load Tscale Register 

AX0=TSCALE; 

DM <Tscale_Reg) =AX0; 



{ Set SPORT0 Control Register : ISCLCK - enable, SLEN =(1+8+1) -1 

AXO=B#0100101000 001001; 
DM (Sport0_Ctrl_Reg) =AX0 ; 



{ Set SPORT0 Clock Divider to 19200 baud 

AX0=0xl3f ; 

DM (Sport 0_Sclkdiv) =AX0 ; 



{ Set SPORT1 Control Register : ISCLCK - enable, SLENM8-1) 

AX0=0x4a07; 

DM (Sporti_Ctrl_Reg) =AX0 ; 



{ Set SPORTl Clock Divider to 80000 cycles 

AX0=0x004c ; 

DM (Sport l_Sclkdiv) =AX0 ; 



.INIT 
.INIT 
Startup: 
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10 



Set Parameters of Circ Buffer Package 

I0 = A Package,- 
M0=1; 

LO=%Package; 
11=10; 



15 



Set Interrupt Control Reg, Set I MASK Reg, Set MSTAT Reg } 

ICNTL=0xl7 ; 
IMASK«0x3 9; 
MSTAT=0x3 0; 



Set Parameters of Circ Buffer Shifter const 



20 



I2= A Shif ter_Const ; 

I3=~Masks; 

M2 = l; 

M3=l; 

L2=%Shifter_Const; 
L3-%Masks; 



25 



RTS; 



. ENDMOD ; 



30 



35 



40 



45 



50 



55 
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. MODULE / S EG «=prog_mem ibmwacOl ; 

. INCLUDE <d : \adi_dsp\include\def 2101 . h> ; 

. CONST MASK_RS232=B#0000000001; 
. CONST DATA_BITS_1=B#11111110; 
. CONST DATA_B ITS_2 =B#0 0 0 0 0 0 001 1 1 11 1 100 ; 
. CONST MASK_SYNCHROBIT~B#100000000; 
10 . CONST EXCITATION_WORD=0x0055; 

.EXTERNAL Startup; 

. EXTERNAL Revers ; 

. PORT x_counter_port ; 

.PORT y counter port; 

. EXTERNAL Package ; 



15 



40 



55 



JUMP StartMouse; NOP; NOP; NOP; { Interupt vector table} 



RTI; NOP; NOP; NOP 

. JUMP Transmit_Next 
RTI; NOP; NOP; NOP 
RTI; NOP; NOP; NOP 
20 RTI ; NOP; NOP; NOP 

JUMP Sampling; NOP 



NOP; NOP; NOP; 



No interrupts used} 



NOP; NOP; 

StartMouse: {Setting all Control Registers and other parameters} 
{ Set system parameters : Timer, SPORT'S } 

25 CALL Startup; 

< - } 

{ Set Parameters of Circ Buffer 

10=^ Package; 
_ MO-1? 
30 L0 =% Package; 

11-10; 

{ } 

{ Set Interrupt Control Reg, Set I MASK Reg, Set MSTAT Reg 

35 ICNTL=0xl7 
IMASK=0x39 
MSTAT=0x30*j 



{ Send first signal to UST } 

TXl=EXCITATION_WORD; 
{ } 

MLoop: {Main loop of program) 

IDLE '* {Wait for Timer Interrupt} 

^ JUMP MLoop; 

Sampling: {Timer Interrupt Service routine {every 3ms) } 



MRO-DM (x_counter_port) ; 
MR1-DM (y_counter_porC ) ; 
50 TXl=EXCITATION WORD; 



Read X counter} 
Read Y counter) 
Transmit signal to *UST} 



eeeeeeeeOeeeeeeeeeOeeeeeeeeeaeeeeeteeeeeiee^eeieeeeeiee 

a Pack, n 9 a $ □7°6 0 5 0 40 3 02 ° 1 a 0 a 
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15 



45 



D for aeeeeeeeee6eeeeeeeeeoee£eeueee^ ^ 
° PC DStart Bitnsync. Bitn Data Bits QStop n 

Deeeeeeeoeeeeeeeeeoeeeeeeeeeoeeeeeiee 

CByte in 0 a 1 a PEN ° Fll ° F10 ° F09 ° F08 ° F07 ° F06 a 1 n 
uaaaaaaaae^aaaa^aaas^^aaaaa 

°Byte 2 ° o n o □ 0 ° F05 ° F04 ° F03 ° F02 ° F01 ° F00 Din 

uaaaaaaa*a£aaa£aaa*a£aaaaaaa^ 

°Byte 3 n o n o □ o ° Sll ° S10 0 S09 ° SOS ° S07 ° S06 n 1 ° 
uaaaaaaaaeaaaaaaaaaaeaaaaaaaaa«aaaaaeaaaaa6aaaaa6aa^aa6aa 

°Byte 4° 0 a 0 n o ° SOS ° S04 ° S03 ° S02 0 SOI ° S00 □ 1 □ 
a^e§§e^aeeeeeeeeeoeeeeeeeee6eeeeeu 

{ Buiding the First byte of Package for PC J 



AR=MASK_RS232 ; 

A Y 0 = MAS K_S YNCHROB I T ; 

AF=AR OR AYO; 

SR=LSHIFT MRO BY 11 (LO) ; 
20 AY1 =DATA_B ITS_1 ; 

AR-SR1 AND AY1; 
CALL Revers; 

SR-LSHIFT AR BY 1 (LO) ; 
AR=SR0 OR AF; 
DM (10, MO ) - AR ; 

25 { .._. r j 

{ Buiding the Second byte of Package for PC } 

AR=MASK_RS232 ; 
AYO-0; 

30 AF=AR OR AYO ; 

SR=LSHIFT MRO BY 18 (LO) ; 
AY1«DATA_BITS_2 ; 
AR=SR1 AND AY1; 
CALL Revers; 

SR~LSHIFT AR BY 1 <LO) ; 
AR=SR0 OR AF; 
35 DM (10, MO ) =AR ; 

{ } 

{ Buiding the Third byte of Package for PC } 

SR=LSHIFT MR1 BY 12 (LO) ; 
40 AY1«DATA_BITS_1; 

AR=SR1 AND AY1; 
CALL Revers; 

SR-LSHIFT AR BY 1 (LO) ; 
AR=SR0 OR AF; 
DM( 10, MO) «AR; 

{ L } 

{ Buiding the Fourth byte of Package for PC } 



SR-LSHIFT MR1 BY 18 (LO) 
AY1 =DATA__BITS_1 ; 
AR=SR1 AND AY1; 
qq CALL Revers; 

SR=LSHIFT AR BY 1 (LO) ; 
AR=SR0 OR AF; 
DM(I0,M0)=AR; 
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{ 



Send First Byte to PC 

AX0=DM(IO,MO) ; 
TXO=AXO; 



10 



15 



20 



25 



RTI; 
Transmit Next : 



AX1-I0; 
AY1=I1; 
AR=AX1-AY1; 

IF EQ JUMP Out_Interrupt ; 



Send_Next : 

AXO=DM(IO,MO) ; 
TXO=AXO; 

Out_Interrupt : 

RTI ; 

.ENDMOD; 



30 



35 



. SYSTEM 
.ADSP2101; 
. MMAPO ; 

. SEG/ROM/BOOT==0/CODE 

. SEG/PM/RAM/ABS=0/CODE 

. SEG/DM/RAM/ABS= 0x3 800 /DATA 

. PORT/DM/ABS=0x34 0 0 

. PORT/DM/ ABS=0x34 01 

. ENDSYS ; 



ibmwacomOl ; 



•boot_jpm [2048] ; 
prog__mem [2048] ; 
data_mem[1024] ; 
x_counterjport ; 
y__counter_j?ort ; 



40 



45 



so 
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ext rn int COUNTS1[15000]; 
extern int COUNTS2[15000]; 
extern char pen_up[15000]; 



#define BUFFER_SIZE 60000 

#define MIN_COUNT 850 
#define MAX_COUNT 1800 

#define MINX -120 
#define MINY 700 
#define MAXX 800 
#def!ne MAXY 1600 



#include <stdio.h> 
#include "extern. h" 
int Initialize (void) 
{ 

FILE «fp; 

int ndx=0,tmp; 

if ((fp=fopen ("temp.tsf',"r+t M ))==NULL) 
return -1; 

while (fecanf (fp,"%d %d %d",&COUNTS1[ndx],&COUNTS2[ndxl,&tmp)>0 && 
ndx-c 15000) 

{ 

pen_up[ndx++]=(char)tmp; 

fclose (fp); 

if (ndx== 15000) 

printf ("array exceeds 15000!!! , not all fioleis read\n"); 
return ndx; 
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#include "const.h" 
#include <graphics.h> 
#include <conio.h> 
#include <stdio.h> 
#include <math.h> 
#include <Stdlib.h> 

int Initialize (void); 

void butter_filtO(float inQ.float out[]); 

#define GR_ON 

int COUNTS1 [1 5000],COUNTS2[1 5000]; 
char far pen_up[1 5000]; 
#pragma argsused 



int main ( ) 
{ 

int repl ; 
int i f ndx ; 

unsigned char c1 l c2,fix=0 l fly=0; 

unsigned int count1,count2; 

int gdriver = DETECT, gmode, errorcode; 

int ScrMaxX t ScrMaxY; 

int CountRange.XRange.YRange; 

float x__cor,y_cor; 

float NewCountAX[3] , NewCountAY [3]; 

float CountAX[5] f CountAY[5]; 

float ax=0. f ay=0.; 

float lnFilt[2] t OutFilt[2]; 

int NumPoints ( CountNdx=0; 

float temp; 

#ifdef GR_ON 

initgraph(&gdriver, &gmode, "CiWBORLANDCWBGr 1 )* 
errorcode = graphresult(); 
if (errorcode != grOk) 
{ 

printf("Graphics error: %s\n" ( grapherrormsg(errorcode)); 
printf("Press any key to halt:"); 
getchO; 
return -2; 

#endif 

ScrMaxX= getmaxxO; 
ScrMaxY= getmaxy(); 

CountRange = MAX_COUNT - MIN_COUNT; 
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XRange = MAXX - MINX; 
YRange = MAXY - MINY; 

if ((NumPoints=lnitialize ())<0) 

printf ("unable to initalize\n"); 
return -1 ; 

} 

countl =COUNTS1 (CountNdx]; 
count2=COUNTS2[CountNdx++]; 

NewCouritAX[0]=NewCountAX[1]=NewCountAX[2] =count1 • 
NewCountAY[0]=NewCountAY[1]=NewCountAYt2] =count2; 
CountAX[0]=CountAX[1]=CountAX[2]=count1; 
CountAYT0]=CountAY[1]=CountAY[2]=count2; 
lnFilt[0]=NewCountAX[1]; lnFilt[1]=NewCountAY[1]: 

lnFilt[0]=375. - 

((float)NewCountAX[1 ]*NewCountAX[1 ]- 
(float)NewCountAY[1 ]*NewCou ntAY[ 1 J)/1 500. ; 

temp=(float)NewCountAY[1]*NewCountAY[1]-lnFilt[0]*lnFilt[0]; 
if (temp>0) 

lnFilt[1]=(float)sqrt(temp); 

x_cor = (((InFilttO] - MINX) / (float)XRange ) * ScrMaxX); 

y_cor - (((lnFilt[1] - MINY) / (float)YRange ) * ScrMaxY); 
#ifdef GR_ON 

moveto (x_cor,y_cor); 
#endif 

ndx=0; 

NewCountAX[0]=NewCountAX[1]=NewCountAX[2]=COUNTS1[CountNdx]; 
NewCountAY[0]= NewCountAY[1 ]=NewCountAYI2]=COUNTS2tCountNdx]; 

CountAX[0]=CountAX[1]=CountAX[2]=CountAXI3]=CountAX[4]=COUNTS1[CountNdx]; 

CountAYt0]=CountAY[1]=CountAY[2]=CountAY[3]=CountAY[4]=COUNTS2[CountN 
dx++]; 

while (CountNdx<NumPoints) 

countl =COUNTS1[CountNdx]; 
count2=COUNTS2[CountNdx++]; 

NewCountAX[0]=NewCountAX[1]; NewCountAY[0]=NewCountAYt1]; 
NewCountAX[1 ]=NewCountAX[2]; NewCountAYll ]=NewCountAY[2]; 
r NewCountAX(2]=count1; NewCountAY[2l=count2; 
*/ CountAX[0]=CountAX[1]; CountAY[0]=CountAYI1]; 
CountAX[1]=CountAX[2]; CountAY[1]=CountAY[2]; 
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CountAX[2]=CountAX[3]; CountAY[2]=CountAY[3]; 
CountAX[3]=CountAX[4]; CountAY[3]=CountAY[4]; 
CountAX[4]=count1 ; CountAY[4]=count2; 
if ( fix ) 
{ 

NewCountAX[2]=(CountAX[3]-CountAX[0])*2./3.+ NewCountAX[0]; 
fix = 0; 

} 

else 

if (abs(CountAX[2]-NewCountAX[1 }-ax)<1 0) 

NewCountAX[2]=CountAX[2]-ax; 
else if ( abs(CountAX[1]-CountAX[3]) < 12) 

NewCountAX[2]=(CountAX[1]+CountAX[3])/2.- ax; 
else if { abs(CountAX[1]-CountAX[4]) < 12) 
{ 

NewCountAX[2]=(CountAX[4]-CountAX[1 ])/3.+ CountAX[1]-ax; 
fix = 1; 

} 

else 

{float tmp; 

tmp = (NewCountAX[1]-NewCountAX[0]+CountAX[3]-CountAX[2])/2; 
ax=(CountAX[2]-NewCountAX[1 ]-tmp); 
NewCountAX[2]=CountAX[2]-ax; 

} 

if (fly) 
{ 

NewCountAY[2]=(CountAY[3]-CountAY[0])*2./3.+ NewCountAYfO]; 
fly = 0; 

} 

else 

if (abs(CountAY[2]-NewCountAY[1 ]-ay)<1 0) 

NewCountAY[2]=CountAY[2]-ay; 
else if ( abs(CountAY[1]-CountAY[3J) < 12) 

NewCountAY[2]=(CountAY[1]+CountAY[3])/2.- ay; 
else if ( abs(CountAY[1]-CountAY[4]) < 12) 
{ 

NewCountAY[2]=(CountAY[4]-CountAY[1])/3 + CountAY[1]-ay; 
fly=1; 

} 

else 

{float tmp; 

tmp = (NewCountAYl1]-NewCountAY[0]+CountAY[3]-CountAY[2])/2; 

ay=(CountAY[2]-NewCountAY[1]-tmp); 

NewCountAY[2]=CountAY[2]-ay; 

} 

if (abs(CountAY[1 ]-NewCountAY[0]-ay)<1 0) 
{NewCountAY[1 ]=CountAY[1 ]-ay; apy=ay;} 



EP 0 666 543 A2 



else if ( abs(CountAY[0]-CountAY[2]) < 12) 

. {NewCountAY[1]=(int)(CountAY[0]+CountAY[2])/2.- ay; apy=ay;} 
else if (ay=apy) 

{ 

apy=ay; 

ay=(lnt)(CountAY[1]-NewCountAY[0]); 
NewCountAY[1 ]=CountAY[1 ]-ay; 

} 

*/ 

lnFilt[0]=375. - 

((float)NewCountAX[2]*NewCountAX[2]- 
(float)NewCountAY[2l*NewCountAY[2])/1 500. ; 

temp=(float)NewCountAY[2]*NewCountAY[2]-lnFilt[0]*lnFilt{0]; 
if (temp>0) 

lnFilt[1 ]=(float)sqrt(temp); 

butter_filt0(lnFilt,OutFilt); 

#ifdef GR_ON 

x_cor = (((OutFilt{0] - MINX) / (float)XRange ) * ScrMaxX)*(480./640.); 
y_cor = <((OutFilt[1] - MINY) / (float)YRange ) * ScrMaxY); 
if ( CountNdx>21) 
{ • 
if ( pen_up[CountNdx-20] && !pen_up[CountNdx-21] ) 
moveto ((x_cor-200)*2,(y_cor-1 00)*2); 
else 

if ( pen_up[CountNdx-20J ) 
lineto ((x_cor-200)*2,(y_cor-1 00)*2); 

#endif 

#ifndef GR_ON 

P r i n t f ( " % 0 4 d % 0 .4 d % 0 
%04d\n".NewCountAX[1],NewCountAYT1],(int)OutFilt[0],(int)OutFilt[1]); 
A*printf ("%u %u\n",Buffln,BuffOut);*/ 
ndx++; 

#endif 

if (kbhit()) 
{ 

if (getch()==0) 

getch(); 
break; 

} 

/*if (OverFlowFlag) 
{ 

printf ("Buffer OverFlow\n"); 
continue; 
>*/ 

> 
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rCloselnterrComm ( portbase ) -*/ 
#ifdef GR_ON 

while (!kbhit()) /* do nothing */ ; 

getch(); 
/* closegraph();*/ 
#endif 

return 0 ; 

} 



********************** 



•Reconstruction and drawing of pen's movement and Symbols 

#include <conio.h> 
#include <stdio.h> 
^include <math.h> 
#include <stdlib.h> 



r 

Filtration by low PASS filter Butterworth 4 order, and 
cutoff freq. .04 from half sampling rate 
Input : aray in. 
Output : array out. 

*/ 

void butter_filtO(float inrj.float outrj) 

static float a[5]= {1., -3.6717291. 5.0679984, -3.1 159669, .71991033}; 

static flo at 

b[5]={1 .3293729e-05.5.317491 6e-05.7.9762373e-05,5.31 7491 6e-05, 1 .3293729e-05}; 

static float yt2J[5],x[2][5]; 
int i.j; 

float sum=0.; 
static int fl=0; 

for(j=0;j<2;j++) 
{ 

if ( !fl ) 

for(i=0;i<5;i++) 
{ 

yOJW = in[j]; 
mU] = inffl: 

} 

for(i=4;i>0;i») 

x[j][i] = x0][i-1]; 
xlfflO] = inQ]; 
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if(fl) 
{ 

sum = 0; 

5 for(i=4;i>0;i-) 

yD][i] = yDKi-1]; 

for(i=0;i<5;i++) 
sum += b[ifx[j][i]; 
10 for(i=1;i<5;i++) 

sum -= a[i]*yQ][i]; 

yDJ[0J = sum; 

outD]= sum;; 

} 

else 

outQ] = in[j]; 

} 

if ( !fl ) fl=1; 

} 



30 
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25 

Claims 

1. Handwriting recognition apparatus comprising: 

handwriting input apparatus employing at least two different sensing techniques to sense hand- 
writing and including at least one accelerometer located in a hand held writing implement; and 

symbol identification apparatus receiving an output of the handwriting inputapparatus for providing 
an output indication of symbols represented by the handwriting. 

Apparatus for detecting pen-surface contact comprising: 

at least one accelerometer measuring at least one component of acceleration of a user's hand ma- 
nipulating a pen; and 

a pen-surface contact detector receiving input from the accelerometer which is filtered to remove 
components other than noise. 

40 3. A handwriting recognition method comprising: 

receiving information regarding the acceleration of a writing implement from three mutually ortho- 
gonal accelerometers mounted on the writing implement and 

identifying symbols written by the writing implement at least partly on the basis of a comparison 
between the acceleration of the writing implement and stored acceleration sequences characterizing each 
45 of a plurality of symbols. 

4. Handwriting recognition apparatus comprising: 

a characteristic acceleration sequence memory operative to store acceleration sequences char- 
acterizing each of a plurality of symbols; 

a writing implement monitor operative to receive information regarding acceleration of a writing im- 
plement from three mutually orthogonal accelerometers mounted on said writing implement; and 

a symbol identifier operative to provide an output indication of symbols written by the writing im- 
plement at least partly on th basis of a comparison between the acceleration of the writing implement 
and the stored acceleration sequences. 
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5. A handwriting recognition method comprising: 

employing at least one accelerometer located in a hand held writing implement and at least one 
additional different sensing technique to sense handwriting; and 
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receiving an output indication of the handwriting for providing an output indication of symbols rep- 
resented by the handwriting. 

6. A method for detecting pen-surface contact comprising: 
5 employing at least one accelerometer measuring at least one component of acceleration of a user's 

hand manipulating a pen; and 

receiving an input from the accelerometer which is filtered to remove components other than noise 
and providing an output indication of pen-surface contact 

10 7. Handwriting recognition apparatus comprising: 
handwriting input apparatus including: 

at least first and second different handwriting sensors producing first and second handwrit- 
ing outputs, at least one of said first and said second different handwriting sensors comprising at least 
one accelerometer located in a hand held writing implement; and 
15 an associatorfor combining the first and second handwriting outputs to provide an enhanced 

performance handwriting output; and 

symbol identification apparatus receiving said enhanced performance handwriting output for pro- 
viding an output indication of symbols represented by the handwriting. 

20 8. A handwriting recognition method comprising: 

employing at least one accelerometer located in a hand held writing implement and at least one 
additional sensor to produce first and second handwriting outputs; 

combining the first and second handwriting outputs to provide an enhanced performance hand- 
writing output; and 

25 employing said enhanced performance handwriting output for providing an output indication of sym- 

bols represented by the handwriting. 

9. Hand imaging recognition apparatus comprising: ' 

hand imaging input apparatus employing at least two different sensing techniques to sense hand 
30 imaging and including at least one accelerometer located in a hand held writing implement; and 

shape identification apparatus receiving an output of the hand imaging input apparatus for provid- 
ing an output indication of shapes represented by the hand imaging. 

10. A hand imaging recognition method comprising: 

35 receiving information regarding the acceleration of a writing implement from three mutually ortho- 

gonal accelerometers mounted on said writing implement; and 

identifying shapes written by the writing implement at least partly on the basis of a comparison 
between the acceleration of the writing implement and stored acceleration sequences characterizing each 
of a plurality of shapes. 

40 

11. Hand imaging recognition apparatus comprising: 

a characteristic acceleration sequence memory operative to store acceleration sequences char- 
acterizing each of a plurality of shapes; 

a writing implement monitor operative to receive information regarding acceleration of a writing im- 
45 plement from three mutually orthogonal accelerometers mounted on said writing implement; and 

a shape identifier operative to provide an output indication of shapes written by the writing imple- 
ment at least partly on the basis of a comparison between the acceleration of the writing implement and 
the stored acceleration sequences. 

so 12. A hand imaging recognition method comprising: 

employing at least one accelerometer located in a hand held writing implement and at least one 
additional different sensing technique to sense hand imaging; and 

receiving an output of the hand imaging for providing an output indication of shapes represented 
by th hand imaging. 

55 

13. Hand imaging recognition apparatus comprising: 
hand imaging input apparatus including: 

at least first and second different hand imaging sensors producing first and second hand 
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imaging outputs, at least one of said first and s cond different hand imaging sensors comprising at least 
one accel rometer located in a hand held writing implement; and 

an associator for combining the first and second hand imaging outputs to provide an en- 
hanced performance hand imaging output; and 

shape identification apparatus receiving said enhanced performance hand imaging output for pro- 
viding an output indication of shapes represented by the hand imaging. 

14. A hand imaging recognition method comprising: 

employing at least one accelerometer located in a hand held imaging implement and at least one 
additional sensor to produce first and second hand imaging outputs; 

combining the first and second hand imaging outputs to provide an enhanced performance hand 
imaging output; and 

employing said enhanced performance hand imaging output for providing an output indication of 
shapes represented by the hand imaging. 
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